-- Logs begin at Wed 2022-08-24 09:13:58 UTC, end at Wed 2022-08-24 10:41:07 UTC. -- Aug 24 10:08:13.837463 dv-cinder-854271-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 10:08:13.846268 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 10:08:13.848223 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 10:08:13 2022] *** Aug 24 10:08:13.848223 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 10:08:13.848223 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 10:08:13.848223 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: nodename: dv-cinder-854271-2-iscsi Aug 24 10:08:13.848223 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: machine: x86_64 Aug 24 10:08:13.848223 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: clock source: unix Aug 24 10:08:13.848223 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: pcre jit disabled Aug 24 10:08:13.848223 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: detected number of CPU cores: 4 Aug 24 10:08:13.848223 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: current working directory: / Aug 24 10:08:13.848223 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: detected binary path: /usr/bin/uwsgi-core Aug 24 10:08:13.849182 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: your processes number limit is 47680 Aug 24 10:08:13.849182 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: your memory page size is 4096 bytes Aug 24 10:08:13.849182 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: detected max file descriptor number: 2048 Aug 24 10:08:13.849182 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: lock engine: pthread robust mutexes Aug 24 10:08:13.849182 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: thunder lock: enabled Aug 24 10:08:13.849182 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 10:08:13.849182 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 10:08:13.887856 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: Python main interpreter initialized at 0x561dd28459c0 Aug 24 10:08:13.887856 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: python threads support enabled Aug 24 10:08:13.887856 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: your server socket listen backlog is limited to 100 connections Aug 24 10:08:13.887856 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: your mercy for graceful operations on workers is 90 seconds Aug 24 10:08:13.888204 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 10:08:13.888301 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: *** Operational MODE: preforking *** Aug 24 10:08:13.888530 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: *** uWSGI is running in multiple interpreter mode *** Aug 24 10:08:13.888530 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: spawned uWSGI master process (pid: 106251) Aug 24 10:08:13.888761 dv-cinder-854271-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 10:08:13.889891 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: spawned uWSGI worker 1 (pid: 106252, cores: 1) Aug 24 10:08:13.889891 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: spawned uWSGI worker 2 (pid: 106253, cores: 1) Aug 24 10:08:13.889891 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 10:08:14.560940 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 10:08:14.569259 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 10:08:15.652255 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:08:15.652255 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: from cryptography.utils import int_from_bytes Aug 24 10:08:15.652884 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:08:15.652884 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: from cryptography.utils import int_from_bytes Aug 24 10:08:15.665862 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:08:15.665862 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: from cryptography.utils import int_from_bytes Aug 24 10:08:15.666332 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:08:15.666332 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: from cryptography.utils import int_from_bytes Aug 24 10:08:18.188016 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:08:18.188630 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:08:18.188803 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:08:18.189182 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:08:18.189436 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:08:18.189823 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.190160 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.190477 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.190797 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.191124 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.191412 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:08:18.191782 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.191863 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:08:18.191941 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.192040 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.192193 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:08:18.192359 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.192554 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:08:18.192645 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.192807 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:08:18.192994 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.193215 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.193311 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854271-2-iscsi {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.193540 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.193633 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.193861 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.193947 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.194168 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.194252 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.194541 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.194643 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.194845 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.194936 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.195167 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.195251 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.195473 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.195570 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.195859 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.195967 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.196119 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.196413 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.196528 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.196721 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.196822 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854271-2-iscsi {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.197065 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.197165 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.197431 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.197532 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.197673 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.197770 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.197985 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.198076 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.198284 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.198382 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.198596 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.198681 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.198895 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.198977 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.199219 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.199402 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.199614 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854271-2-iscsi {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.199702 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.199932 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.200023 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.200247 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.200415 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.200548 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.200757 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.200974 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.201155 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.201337 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.201516 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.201692 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.201868 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.202062 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.202211 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.202333 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.202484 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.202607 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.202748 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.202903 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854271-2-iscsi {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.203032 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.203162 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.203292 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.203413 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.203575 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.203700 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.203831 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.204003 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.204138 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.204313 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.204439 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.204621 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.204759 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.204982 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.205113 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.205347 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.205538 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.205650 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.205961 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.206080 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.206277 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.207361 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.207522 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.207683 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.207806 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.208000 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.208126 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.208350 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.208478 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.208630 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.208757 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.208940 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.209086 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.209423 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.209551 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.209683 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.209821 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.210645 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.210794 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.211086 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.211236 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.211361 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.211495 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.211617 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.211737 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.211858 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.211994 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.211994 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.212247 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.212369 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.212490 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.212619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.212749 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.212903 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.213040 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.213173 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.213296 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.213430 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.213552 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.213672 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.213803 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.213931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.214059 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.214193 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.214316 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.214437 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.214558 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.214685 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.214815 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.214937 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.215087 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.215214 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.215427 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.215553 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.215745 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.215879 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.216052 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.216177 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.216371 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.216497 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.216693 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.216819 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.217020 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.217146 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.217326 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.217451 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.217632 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.217758 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.217951 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.218076 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.218252 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.218384 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.218558 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.218687 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.218815 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.218935 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.219096 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.219230 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.219475 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.219609 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.219737 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.219866 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.219993 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.220194 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.220324 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.220453 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.220575 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.220695 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.220882 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.221028 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.221173 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.221299 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.221474 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.221601 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.221776 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.221917 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.222076 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.222200 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.222377 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.222507 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.222678 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.222813 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.222973 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.223098 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.223275 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.223397 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.223574 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.223699 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.223874 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.223999 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.224175 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.224300 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.224477 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.224603 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.224774 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.224919 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.225104 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.225301 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.225472 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.226318 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.226318 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.226584 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.226714 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.226837 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.226968 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.227159 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.227285 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.227467 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.227591 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.227772 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.227912 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.228076 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.228200 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.228382 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.228547 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.228678 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.228811 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.229012 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.229146 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.229313 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.229437 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.229623 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.229762 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.229923 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.230014 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.230227 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.230314 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.230528 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.230615 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.230833 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.230933 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.231133 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.231232 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.231431 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.231518 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.231728 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.231813 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.232025 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.232111 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.232327 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.232422 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.232626 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.232713 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.232951 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.233052 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.233255 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.233350 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.233556 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.233651 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.233855 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.233955 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.234156 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.234249 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.234452 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.234537 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.234751 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.234851 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.235046 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.235133 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.235359 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.235453 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.235677 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.235772 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.235981 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.236067 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.236285 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.236372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.236586 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.236681 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.236923 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:08:18.237014 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.237263 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.237361 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.237594 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.237681 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.237900 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.237984 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.238210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.238296 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.238520 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.238608 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.238838 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.238923 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.239154 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.239240 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.239459 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.239565 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.239772 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.239858 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.240084 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.240183 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.240389 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.240495 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.240697 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.240795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.241026 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.241161 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.241374 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.241530 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.241700 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.241809 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.242007 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.242094 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.242345 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.242433 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.242690 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.242777 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.243005 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.243106 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.243311 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.243404 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.243627 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.243714 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.243940 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.244040 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.244247 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.244334 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.244549 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.244635 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.244893 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.245004 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.245223 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.245311 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.245534 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.245619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.245851 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.245947 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.246163 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.246250 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.246470 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.246564 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.246776 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.246863 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.247086 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.247185 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.247394 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.247479 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.247720 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.247807 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.248031 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.248127 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.248339 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.248432 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.248644 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.248730 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.248980 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.249072 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.249293 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.249390 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.249599 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.249686 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.249905 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.249990 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.250208 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.250303 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.250510 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.250598 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.250811 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.250910 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.251118 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.251213 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.251420 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.251506 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.251725 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.251824 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.252034 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.252129 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.252338 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.252424 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.252635 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.252722 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.252960 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.253067 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.253263 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.253351 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.253568 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.253654 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.253868 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.253965 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.254168 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.254254 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.254479 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.254566 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.254782 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.254869 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.255082 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.255180 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.255405 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.255560 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.255705 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.255851 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.256007 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.256094 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.256310 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.256397 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.256609 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.256698 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.256959 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.257061 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.257268 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.257410 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.257578 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.257715 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.257889 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.258036 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.258200 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.258349 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.258512 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.258650 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.258835 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.258970 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.259146 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.259270 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.259459 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.259569 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.259793 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.259884 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.260121 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.260217 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.260425 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.260523 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.260748 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.260834 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.261094 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.261190 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.261408 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.261496 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.261713 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.261801 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.262020 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.262113 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.262322 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.262407 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.262625 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.262929 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.263107 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.263238 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.263420 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.263546 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.263739 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.263850 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.264067 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.264152 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.264380 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.264457 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.264687 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.264764 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.265017 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.265100 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.265386 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.265473 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.265647 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.265952 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.266255 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.266600 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.266904 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.267500 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.267843 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.268047 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.268163 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.268393 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.268480 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.268735 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.268824 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.269093 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.269183 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.269401 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.269495 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.269711 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.269806 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.270022 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.270104 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.270331 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.270417 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.270649 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.270744 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.270961 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.271060 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.271271 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.271367 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.271577 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.271752 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.271884 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.271970 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.272195 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.272288 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.273079 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.273189 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.273430 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.273572 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.273772 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.273893 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.274096 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.274238 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.274422 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.274576 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.274739 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.274899 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.275057 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.275224 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.275371 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.275542 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.275686 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.275858 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.276001 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.276168 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.276315 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.276481 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.276644 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.276794 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.276981 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.277133 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.277305 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.277453 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.277617 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.277765 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.277940 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.278083 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.278252 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.278394 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.278574 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.278715 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.278879 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.279023 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.279196 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.279341 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.279537 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.279632 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.279869 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.279957 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.280186 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.280275 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.280508 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.280610 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.280819 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.280928 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.281154 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.281244 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.281464 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.281561 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.281776 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.281875 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.282081 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.282175 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.282389 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.282485 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.282691 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.282776 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.282994 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.283081 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.283304 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.283391 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.283608 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.283700 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.283913 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.283999 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.284219 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.284307 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.284521 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.284608 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.284825 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.284932 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.285162 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.285257 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.285465 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.285559 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.285765 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.285858 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.286073 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.286160 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.286391 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.286477 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.286701 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.286796 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.287018 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.287111 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.287335 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.287422 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.287636 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.287736 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.287938 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.288645 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.288823 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.288995 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.289167 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.289268 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.289480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.289569 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.289788 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.289876 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.290094 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.290191 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.290455 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.290769 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.290904 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.291073 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.291197 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.291389 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.291506 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.291756 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.291888 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.291993 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.292107 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.292303 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.292417 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.292613 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.292727 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.293003 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.293116 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.293266 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.293585 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.293893 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.294204 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.294513 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.295145 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.295230 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.295312 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.295391 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.295480 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.295679 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.295776 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.296007 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.296098 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.296315 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.296411 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.296618 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.296717 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.296953 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.297044 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.297270 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.297380 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.297601 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.297848 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.297934 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.298186 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.298282 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.298505 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.298593 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.298827 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.298922 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.299150 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.299239 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.299468 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.299562 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.299786 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.299882 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.300098 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.300199 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.300412 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.300499 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.300736 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.300930 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.301089 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.301175 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.301397 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.301485 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.301704 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.301810 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.302015 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.302104 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.302320 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.302408 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.302627 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.302715 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.302933 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.303019 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.303243 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.303332 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.303549 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.303666 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.303884 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.304064 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.304189 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.304388 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.304500 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.304697 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.304817 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.305042 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.305349 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.305436 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.305664 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.305764 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.305969 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.306066 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.306290 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.306378 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.306600 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.306687 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.306904 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.307000 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.307207 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.307295 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.307510 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.307598 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.307851 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.307947 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.308153 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.308253 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.308474 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.308560 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.308776 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.308882 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.309106 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.309236 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.309416 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.309511 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.309719 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.309815 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.310023 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.310112 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.310323 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.310412 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.310622 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.310760 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.310921 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.311008 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.311227 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.311314 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.311527 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.311621 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.311825 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.311912 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.312134 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.312222 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.312436 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.312533 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.312740 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.312828 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.313068 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.313156 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.313374 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.313471 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.313681 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.313768 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.313981 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.314067 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.314284 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.314373 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.314586 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.314672 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.314887 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.314975 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.315187 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.315275 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.315495 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.315581 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.315799 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.315887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.316098 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.316187 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.316405 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.316493 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.316704 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.316801 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.317055 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.317222 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.317357 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.317533 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.317658 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.317837 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.317959 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.318140 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.318265 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.318448 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.318570 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.318755 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.318868 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.319055 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.319187 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.319470 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.319566 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.319797 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.319894 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.320113 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.320199 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.320419 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.320507 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.320722 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.320813 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.321049 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.321138 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.321354 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.321455 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.321675 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.321764 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.321984 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.322079 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.322284 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.322378 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.322584 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.322670 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.322883 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.322968 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.323185 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.323282 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.323483 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.323576 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.323784 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.323871 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.324081 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.324176 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.324378 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.324464 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.324677 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.324765 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.324997 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.325098 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.325296 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.325390 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.325599 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.325694 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.325906 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.326001 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.326202 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.326288 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.326501 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.326594 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.326803 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.326893 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.327107 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.327194 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.327406 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.327502 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.327712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.327802 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.328011 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.328099 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.328310 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.328405 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.328616 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.328704 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.328970 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.329073 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.329279 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.329375 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.329578 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.329665 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.329877 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.329963 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.330175 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.330270 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.330475 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.330563 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.330774 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.330869 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.331070 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.331165 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.331365 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.331452 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.331663 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.331751 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.331960 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.332050 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.332259 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.332347 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.332554 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.332642 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.332899 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.332992 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.333220 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.333317 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.333535 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.333675 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.333837 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.333928 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.334133 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.334220 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.334438 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.334525 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.334749 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.334841 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.335625 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.335736 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.335995 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.336092 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.336307 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.336395 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.336624 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.336720 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.336989 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.337098 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.337305 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.337402 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.337617 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.337705 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.337918 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.338016 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.338228 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.338322 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.338534 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.338627 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.338842 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.338939 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.339142 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.339230 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.339440 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.339527 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.339747 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.339834 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.340053 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.340149 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.340359 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.340445 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.340662 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.340757 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.341010 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.341101 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.341334 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.341421 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.341634 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.341723 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.341939 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.342026 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.342247 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.342385 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.342552 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.342641 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.342857 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.342944 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.343164 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.343262 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.343471 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.343559 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.343777 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.343900 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.344086 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.344221 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.344397 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.344534 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.344705 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.344848 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.345034 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.345176 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.345343 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.345479 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.345649 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.345791 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.345957 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.346117 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.346281 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.346409 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.346590 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.346712 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.346892 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.347015 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.347197 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.347338 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.347500 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.347643 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.347807 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.347964 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.348108 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.348382 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.348536 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.348694 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.348848 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.349029 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.349180 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.349447 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.349542 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.349757 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.349855 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.350066 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.350161 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.350377 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.350468 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.350750 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.350866 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.351056 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.351199 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.351469 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.351557 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.351779 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.351869 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.352090 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.352179 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.352397 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.352494 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.352698 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.352787 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.353022 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.353116 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.353332 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.353420 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.353648 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.353745 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.353948 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.354041 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.354249 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.354345 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.354548 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.354637 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.354867 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.354954 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.355170 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.355294 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.355489 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.355618 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.355905 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.356007 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.356214 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.356311 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.356516 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.356618 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.356832 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.356984 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.357161 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.357248 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.357471 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.357568 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.357777 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.357866 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.358083 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.358170 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.358404 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.358505 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.358708 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.358796 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.359018 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.359105 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.359329 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.359419 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.359636 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.359723 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.359937 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.360025 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.360238 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.360327 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.360549 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.360648 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.360849 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.360968 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.361192 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.361286 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.361502 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.361588 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.361812 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.361900 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.362131 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.362225 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.362435 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.362569 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.362756 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.362853 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.363064 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.363152 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.363366 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.363454 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.363669 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.363766 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.363972 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.364073 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.364319 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.364413 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.364624 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.364746 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.364953 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.365046 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.365260 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.365360 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.365576 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.365685 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.365884 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.365973 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.366725 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.366833 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.367062 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.367360 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.367534 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.367688 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.367840 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.368009 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.368145 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.368339 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.368467 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.368647 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.368771 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.368980 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.369117 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.369297 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.369429 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.369603 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.369748 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.369911 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.370056 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.370215 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.370355 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.370525 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.370675 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.370829 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.370984 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.371132 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.371286 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.371436 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.371589 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.371758 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.371891 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.372062 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.372229 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.372386 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.372531 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.372697 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.372850 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.373028 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.373204 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.373350 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.373530 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.373636 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.373836 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.373938 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.374165 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.374254 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.374485 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.374576 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.374801 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.374890 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.375116 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.375205 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.375438 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.375527 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.375740 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.375828 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.376043 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.376133 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.376350 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.376439 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.376657 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.376754 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.376982 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.377075 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.377286 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.377384 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.377591 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.377682 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.377891 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.377993 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.378191 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.378280 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.378491 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.378581 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.378808 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.379024 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.379113 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.379355 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.379442 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.379669 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.379765 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.379982 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.380071 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.380298 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.380452 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.380596 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.380686 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.380935 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.381026 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.381248 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.381336 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.381559 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.381727 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.382469 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.382631 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.382847 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.383002 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.383084 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.383238 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.383401 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.383606 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.383725 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.383924 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.384061 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.384240 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.384380 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.384555 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.384700 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.384913 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.385027 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.385203 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.385346 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.385509 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.385701 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.385822 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.386017 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.386134 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.386322 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.386452 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.386635 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.386947 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.387046 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.387259 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.387349 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.387569 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.387657 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.387878 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.387967 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.388189 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.388285 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.388500 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.388590 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.388807 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.388928 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.389140 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.389229 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.389450 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.389539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.389761 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.389850 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.390082 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.390169 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.390418 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.390514 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.390734 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.390821 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.391047 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.391142 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.391360 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.391457 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.391674 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.391761 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.391985 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.392192 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.392563 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.392771 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.392958 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.393143 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.393266 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.393478 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.393582 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.393803 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.393892 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.394119 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.394213 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.394435 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.394532 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.394763 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.394856 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.395068 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.395154 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.395373 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.395473 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.395681 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.395768 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.395989 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.396079 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.396291 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.396378 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.396601 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.396688 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.396945 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.397074 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.397261 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.397382 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.397611 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.397726 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.397941 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.398122 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.398257 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.398568 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.398655 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.398878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.398997 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.399188 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.399313 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.399638 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.399726 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.399962 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.400049 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.400278 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.400367 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.400583 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.400671 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.400927 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.401017 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.401234 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.401331 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.401537 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.401626 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.401851 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.401948 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.402159 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.402247 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.402458 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.402544 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.402762 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.402858 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.403065 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.403162 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.403365 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.403455 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.403666 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.403761 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.403977 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.404066 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.404274 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.404361 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.404589 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.404686 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.404913 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.405004 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.405220 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.405440 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.405527 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.405786 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.405877 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.406099 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.406197 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.406398 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.406494 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.406700 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.406787 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.407002 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.407096 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.407310 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.407406 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.407609 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.407704 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.407918 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.408005 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.408219 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.408321 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.408528 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.408616 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.408830 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.408930 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.409152 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.409287 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.409455 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.409542 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.409761 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.409855 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.410067 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.410158 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.410367 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.410454 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.410673 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.410769 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.410975 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.411064 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.411299 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.411388 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.411603 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.411702 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.411902 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.411992 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.412204 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.412292 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.412513 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.412813 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.413220 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.413415 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.413978 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.414078 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.414339 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.414651 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.414955 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.415042 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.415263 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.415351 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.415565 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.415667 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.415876 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.415966 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.416178 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.416281 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.416483 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.416581 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.416784 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.416897 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.417135 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.417224 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.417438 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.417542 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.417783 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.417873 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.418097 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.418186 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.418403 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.418499 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.418715 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.418802 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.419018 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.419113 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.419326 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.419416 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.419636 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.419724 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.419948 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.420035 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.420259 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.420485 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.420575 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.420818 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.420972 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.421160 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.421250 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.421483 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.421571 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.421797 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.421893 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.422100 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.422188 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.422403 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.422490 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.422704 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.422792 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.423025 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.423115 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.423333 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.423421 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.423642 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.423731 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.423950 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.424038 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.424254 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.424341 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.424560 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.424654 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.424879 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.424969 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.425193 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.425291 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.425501 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.425599 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.425809 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.425897 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.426115 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.426258 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.426420 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.426554 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.426726 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.426815 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.427039 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.427147 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.427345 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.427472 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.427655 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.427751 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.427992 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.428080 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.428308 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.428410 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.429156 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.429296 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.429486 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.429653 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.429804 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.429969 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.430139 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.430278 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.430468 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.430586 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.430792 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.430880 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.431100 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.431195 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.431406 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.431508 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.431710 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.431798 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.432019 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.432106 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.432336 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.432434 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.432645 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.432783 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.432968 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.433121 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.433274 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.433438 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.433584 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.433756 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.433888 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.434063 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.434193 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.434384 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.434481 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.434706 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.434804 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.435017 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.435115 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.435333 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.435422 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.435640 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.435728 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.435944 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.436040 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.436245 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.436333 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.436547 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.436691 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.436848 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.436978 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.437177 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.437266 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.437481 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.437615 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.437784 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.437874 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.438134 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.438228 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.438386 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.438482 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.438686 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.438791 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.438984 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.439077 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.439285 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.439383 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.439591 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.439680 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.439891 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.439986 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.440192 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.440290 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.440491 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.440580 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.440789 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.440900 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.441120 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.441222 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.441420 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.441509 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.441718 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.441807 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.442017 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.442183 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.442314 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.442404 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.442610 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.442709 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.442907 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.442989 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.443211 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.443297 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.443512 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.443648 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.443814 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.443912 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.444113 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.444209 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.445080 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.445195 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.445413 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.445504 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.445727 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.445823 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.446054 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.446143 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.446374 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.446463 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.446696 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.446783 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.447005 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.447103 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.447314 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.447404 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.447630 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.447718 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.447937 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.448033 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.448245 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.448333 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.448551 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.448639 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.448869 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.448972 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.449196 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.449283 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.449502 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.449589 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.449809 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.449897 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.450115 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.450203 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.450421 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.450517 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.450728 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.450819 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.451048 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.451135 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.451372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.451460 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.451682 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.451771 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.452006 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.452094 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.452330 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.452418 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.452666 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.452754 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.453002 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.453093 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.453315 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.453416 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.453624 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.453720 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.453948 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.454036 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.454255 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.454353 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.454554 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.454640 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.454794 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:08:18.454896 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.455148 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.455455 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.455766 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.456072 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.456379 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.456692 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.457031 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.457354 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.457682 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.457990 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.458312 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.458635 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.458979 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.459290 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.459629 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.460048 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.460386 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.460700 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.461028 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:08:18.461271 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:08:18.608468 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO dbcounter [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Registered counter for database nova_api Aug 24 10:08:18.614014 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO dbcounter [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Registered counter for database nova_api Aug 24 10:08:18.629564 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_db.sqlalchemy.engines [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:08:18.634078 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG oslo_db.sqlalchemy.engines [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:08:18.636734 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writer thread running {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:08:18.640427 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writer thread running {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:08:18.693007 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.context [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),21af12e8-eed5-417b-a9f1-00673b481ea2(cell1) {{(pid=106253) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 10:08:18.696396 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.context [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),21af12e8-eed5-417b-a9f1-00673b481ea2(cell1) {{(pid=106252) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 10:08:18.697468 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:18.697941 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:18.699539 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:18.700225 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:18.700332 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:18.700673 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:18.700765 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:18.702269 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:18.702667 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:18.702988 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:18.703422 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:18.704634 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO dbcounter [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Registered counter for database nova_cell0 Aug 24 10:08:18.705747 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:18.707709 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO dbcounter [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Registered counter for database nova_cell0 Aug 24 10:08:18.710748 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO dbcounter [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Registered counter for database nova_cell1 Aug 24 10:08:18.713892 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO dbcounter [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Registered counter for database nova_cell1 Aug 24 10:08:18.718230 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_db.sqlalchemy.engines [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:08:18.720244 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_db.sqlalchemy.engines [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:08:18.723302 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG oslo_db.sqlalchemy.engines [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:08:18.724093 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG oslo_db.sqlalchemy.engines [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:08:18.727387 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writer thread running {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:08:18.728836 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writer thread running {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:08:18.731451 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writer thread running {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:08:18.732945 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writer thread running {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:08:18.872073 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO dbcounter [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Registered counter for database nova_cell0 Aug 24 10:08:18.878878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO dbcounter [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Registered counter for database nova_cell0 Aug 24 10:08:18.880838 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_db.sqlalchemy.engines [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:08:18.886146 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writer thread running {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:08:18.888729 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG oslo_db.sqlalchemy.engines [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:08:18.893263 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writer thread running {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:08:19.305002 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: WARNING keystonemiddleware.auth_token [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:08:19.312295 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: WARNING keystonemiddleware.auth_token [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:08:19.320304 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: WARNING keystonemiddleware.auth_token [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:08:19.327498 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: WARNING keystonemiddleware.auth_token [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:08:19.660153 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: WARNING keystonemiddleware.auth_token [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:08:19.666447 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: WARNING keystonemiddleware.auth_token [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:08:19.671390 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: WARNING keystonemiddleware.auth_token [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:08:19.671695 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561dd28459c0 pid: 106253 (default app) Aug 24 10:08:19.673793 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:19.674975 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001773 Aug 24 10:08:19.675375 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Wed Aug 24 10:08:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:08:19.677305 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: WARNING keystonemiddleware.auth_token [None req-6e78523d-a86e-415f-8e67-0ee4012432cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:08:19.683165 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561dd28459c0 pid: 106252 (default app) Aug 24 10:09:42.135550 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:42.136785 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 Aug 24 10:09:42.137503 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:09:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:09:42.150575 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_api:SELECT=3 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:42.151439 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_cell0:SELECT=3 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:42.152181 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_cell1:SELECT=3 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:42.153411 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:43.030549 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-5cdb5bfc-7244-440c-9cef-4223e2bdc6ac admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:43.063042 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-5cdb5bfc-7244-440c-9cef-4223e2bdc6ac admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917888 Aug 24 10:09:43.064289 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Wed Aug 24 10:09:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:09:45.457274 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:45.458067 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-1a20ec83-6794-4915-9472-82e24da7c1a1 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002352 Aug 24 10:09:45.469922 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:09:45 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:09:45.904452 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-6a404bd6-43a9-42bc-9051-33fe476916ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "ram": 256}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:09:45.925668 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:09:45.925668 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: warnings.warn(msg) Aug 24 10:09:46.022725 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-6a404bd6-43a9-42bc-9051-33fe476916ac admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.558108 Aug 24 10:09:46.024278 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Aug 24 10:09:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:09:46.040336 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_api:SELECT=3 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:46.040336 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_cell1:SELECT=3 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:46.040336 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_cell0:SELECT=3 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:46.041032 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:09:46.255143 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-bee68536-4412-4f69-a095-ee27825ea2c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:09:46.259510 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:09:46.259510 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: warnings.warn(msg) Aug 24 10:09:46.381900 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-bee68536-4412-4f69-a095-ee27825ea2c8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.349401 Aug 24 10:09:46.382486 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Wed Aug 24 10:09:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:09:48.831531 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-6a404bd6-43a9-42bc-9051-33fe476916ac admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:48.832738 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-6a404bd6-43a9-42bc-9051-33fe476916ac admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002357 Aug 24 10:09:48.833241 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:09:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:09:49.507319 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-ff456c57-a0f8-4528-9a98-cf8ee5453f58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "ram": 512, "swap": 0}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:09:49.526827 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:09:49.526827 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: warnings.warn(msg) Aug 24 10:09:49.650204 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-ff456c57-a0f8-4528-9a98-cf8ee5453f58 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.809215 Aug 24 10:09:49.651700 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Aug 24 10:09:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:09:49.663740 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-5b23b3be-3f0a-4405-a9e4-e76bb926cb8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:09:49.670292 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:09:49.670292 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: warnings.warn(msg) Aug 24 10:09:49.830559 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-5b23b3be-3f0a-4405-a9e4-e76bb926cb8b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.170800 Aug 24 10:09:49.833034 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Wed Aug 24 10:09:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:09:52.248034 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-ff456c57-a0f8-4528-9a98-cf8ee5453f58 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:52.249010 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-ff456c57-a0f8-4528-9a98-cf8ee5453f58 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 24 10:09:52.249732 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:09:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:09:52.656596 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-c2ba08e9-d1d1-49bf-9d3b-e14ec4d98141 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:09:52.744436 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-c2ba08e9-d1d1-49bf-9d3b-e14ec4d98141 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487845 Aug 24 10:09:52.745026 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Aug 24 10:09:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:09:52.757814 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-b0023717-65e4-4cae-9891-9ecbcc3710fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:09:52.840106 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-b0023717-65e4-4cae-9891-9ecbcc3710fe admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085806 Aug 24 10:09:52.840628 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Wed Aug 24 10:09:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:09:55.260672 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-c2ba08e9-d1d1-49bf-9d3b-e14ec4d98141 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:55.261929 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-c2ba08e9-d1d1-49bf-9d3b-e14ec4d98141 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Aug 24 10:09:55.262437 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:09:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:09:55.702425 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-d75fedf3-f513-4486-affe-d6af494474cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:09:55.779608 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-d75fedf3-f513-4486-affe-d6af494474cb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509886 Aug 24 10:09:55.780162 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Aug 24 10:09:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:09:55.793498 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-83d7ad1c-5fce-441f-a502-78f1426cac15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:09:55.886100 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-83d7ad1c-5fce-441f-a502-78f1426cac15 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096522 Aug 24 10:09:55.893239 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Wed Aug 24 10:09:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:09:58.299800 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-d75fedf3-f513-4486-affe-d6af494474cb admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:09:58.300829 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-d75fedf3-f513-4486-affe-d6af494474cb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 24 10:09:58.301448 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:09:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:09:58.739090 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-ab28208a-f6bc-4d1b-b252-2940aa0b21b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "disk": 20, "id": "d4", "swap": 0}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:09:58.899526 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-ab28208a-f6bc-4d1b-b252-2940aa0b21b6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.591815 Aug 24 10:09:58.900197 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Aug 24 10:09:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:09:58.912966 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-02993867-fd8e-4521-8559-0ff784563ee9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:09:59.052191 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-02993867-fd8e-4521-8559-0ff784563ee9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142820 Aug 24 10:09:59.053047 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Wed Aug 24 10:09:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:10:01.423369 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-ab28208a-f6bc-4d1b-b252-2940aa0b21b6 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:01.425392 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-ab28208a-f6bc-4d1b-b252-2940aa0b21b6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Aug 24 10:10:01.425392 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:10:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:01.861673 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-1edce1d3-3cdf-4a80-987c-6d709e0aa1c6 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:01.886930 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-1edce1d3-3cdf-4a80-987c-6d709e0aa1c6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454978 Aug 24 10:10:01.887492 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Wed Aug 24 10:10:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:10:04.672409 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-ab28208a-f6bc-4d1b-b252-2940aa0b21b6 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:04.674801 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-ab28208a-f6bc-4d1b-b252-2940aa0b21b6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002876 Aug 24 10:10:04.675363 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:10:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:05.152952 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-0d56b004-995c-408f-9884-7a0580803314 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "name": "m1.tiny", "ram": 512}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:05.237137 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-0d56b004-995c-408f-9884-7a0580803314 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.554981 Aug 24 10:10:05.237867 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Aug 24 10:10:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:10:05.256618 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-96877885-51a7-454f-b259-85a61981f93f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:05.362890 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-96877885-51a7-454f-b259-85a61981f93f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115099 Aug 24 10:10:05.363657 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Wed Aug 24 10:10:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:10:07.772506 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-0d56b004-995c-408f-9884-7a0580803314 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:07.773553 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-0d56b004-995c-408f-9884-7a0580803314 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 24 10:10:07.773957 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:10:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:08.210872 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-217709d5-d185-4990-bcd0-7125b0aa3d0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:08.316545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-217709d5-d185-4990-bcd0-7125b0aa3d0c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.536402 Aug 24 10:10:08.317268 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Aug 24 10:10:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:10:08.330043 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-a9f11a85-951b-4ccb-834f-e13ffee62748 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:08.431193 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-a9f11a85-951b-4ccb-834f-e13ffee62748 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105218 Aug 24 10:10:08.431855 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Wed Aug 24 10:10:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:10:10.892146 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-217709d5-d185-4990-bcd0-7125b0aa3d0c admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:10.893197 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-217709d5-d185-4990-bcd0-7125b0aa3d0c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Aug 24 10:10:10.893598 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:10:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:11.377398 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-86d7fd1a-fbc6-4615-ae80-2cc0029769bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "name": "m1.medium", "ram": 4096, "swap": 0, "id": "3", "os-flavor-access:is_public": true}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:11.459144 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-86d7fd1a-fbc6-4615-ae80-2cc0029769bc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.559182 Aug 24 10:10:11.465028 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Aug 24 10:10:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:10:11.473724 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-d7f8d583-35ff-48a8-ab94-e008b2174df7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:11.606003 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-d7f8d583-35ff-48a8-ab94-e008b2174df7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135741 Aug 24 10:10:11.606904 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Wed Aug 24 10:10:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:10:14.047461 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-86d7fd1a-fbc6-4615-ae80-2cc0029769bc admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:14.049643 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-86d7fd1a-fbc6-4615-ae80-2cc0029769bc admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002563 Aug 24 10:10:14.050651 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:10:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:14.553502 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-79c005fa-3914-4f9b-a883-441e242348bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:14.560155 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:15.471964 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-79c005fa-3914-4f9b-a883-441e242348bc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.414332 Aug 24 10:10:15.472532 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Aug 24 10:10:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:10:15.486326 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-99f3afb7-c9e0-40e5-8a37-da3836363b1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:15.611615 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-99f3afb7-c9e0-40e5-8a37-da3836363b1c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130395 Aug 24 10:10:15.612916 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Wed Aug 24 10:10:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:10:18.059478 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-79c005fa-3914-4f9b-a883-441e242348bc admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:18.060027 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-79c005fa-3914-4f9b-a883-441e242348bc admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Aug 24 10:10:18.060593 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:10:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:18.543227 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-13603c91-b04b-49df-b1fc-59e12d14143c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "disk": 160, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:18.645952 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-13603c91-b04b-49df-b1fc-59e12d14143c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.576968 Aug 24 10:10:18.647708 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Wed Aug 24 10:10:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:10:18.662384 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-83027464-645f-488b-aae9-48d6b518f169 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:18.748595 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-83027464-645f-488b-aae9-48d6b518f169 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090029 Aug 24 10:10:18.749363 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Wed Aug 24 10:10:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:10:37.378356 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-13603c91-b04b-49df-b1fc-59e12d14143c admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:37.379381 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-13603c91-b04b-49df-b1fc-59e12d14143c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 10:10:37.379788 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:10:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:37.794216 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-3e1dc17b-4fd0-4703-b485-050e616b16f6 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:37.813356 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-3e1dc17b-4fd0-4703-b485-050e616b16f6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.427350 Aug 24 10:10:37.813821 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Wed Aug 24 10:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:10:38.892931 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-13603c91-b04b-49df-b1fc-59e12d14143c admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:38.893962 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-13603c91-b04b-49df-b1fc-59e12d14143c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 24 10:10:38.894428 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:10:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:39.430368 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-2f8c1372-c923-458c-aad1-ea15d32e694a admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:39.436131 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.wsgi [None req-2f8c1372-c923-458c-aad1-ea15d32e694a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-2f8c1372-c923-458c-aad1-ea15d32e694a admin admin] Request method failure captured: Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Accept: application/json Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Accept-Encoding: gzip, deflate Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Connection: keep-alive Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Content-Length: 0 Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Host: 10.222.0.30 Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Openstack-Api-Version: compute 2.90 Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Openstack-System-Scope: None Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: User-Agent: python-novaclient Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Auth-Token: gAAAAABjBfkeSf9iZ1jblBqZLesExww7sgvxdZVR-bh4ZD7wot54Cv0p13GN8sshHLdULfP-l-99w9bAGxjWKqe19IIUh0OCP8TRJNcXbGTR8EYWS8DhtNdGEoCfDZa23IPBsLM_o-xFIphZO2d__lPayYEKE8gjmu5B09iQIU8rD6EAU9pDP_4 Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Domain-Id: None Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Domain-Name: None Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Identity-Status: Confirmed Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Is-Admin-Project: True Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Domain-Id: default Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Domain-Name: Default Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Name: admin Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Role: reader,member,admin Aug 24 10:10:39.439619 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Roles: reader,member,admin Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85765b8a176a42c8b2b1e092bbcf9c4f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Tenant: admin Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Tenant-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Tenant-Name: admin Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User: admin Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Domain-Id: default Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Domain-Name: Default Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Id: deb4aa9488e54d0eafc940ddd57f345d Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Name: admin Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: method: > Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: exception: Flavor 42 could not be found. Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: action_args: {'id': '42'} Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:10:39.441480 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:39.442545 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:39.443931 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-2f8c1372-c923-458c-aad1-ea15d32e694a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:10:39.445294 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-2f8c1372-c923-458c-aad1-ea15d32e694a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.411121 Aug 24 10:10:39.445294 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Aug 24 10:10:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:39.450689 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-fb15af5f-b288-4b4b-9a97-7d85aae80735 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:39.455052 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:10:39.474544 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-fb15af5f-b288-4b4b-9a97-7d85aae80735 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027371 Aug 24 10:10:39.475118 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Aug 24 10:10:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:10:39.486395 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-fed0a952-9293-45c2-b270-a125964f10c7 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:39.509833 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-fed0a952-9293-45c2-b270-a125964f10c7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028128 Aug 24 10:10:39.510395 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Aug 24 10:10:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:10:39.521113 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-7546b65a-ccbc-47b9-8b2a-f9c373dee6ec admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:39.527085 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.wsgi [None req-7546b65a-ccbc-47b9-8b2a-f9c373dee6ec admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-7546b65a-ccbc-47b9-8b2a-f9c373dee6ec admin admin] Request method failure captured: Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Accept: application/json Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Accept-Encoding: gzip, deflate Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Connection: keep-alive Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Content-Length: 0 Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Host: 10.222.0.30 Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Openstack-Api-Version: compute 2.90 Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Openstack-System-Scope: None Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: User-Agent: python-novaclient Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Auth-Token: gAAAAABjBfkeSf9iZ1jblBqZLesExww7sgvxdZVR-bh4ZD7wot54Cv0p13GN8sshHLdULfP-l-99w9bAGxjWKqe19IIUh0OCP8TRJNcXbGTR8EYWS8DhtNdGEoCfDZa23IPBsLM_o-xFIphZO2d__lPayYEKE8gjmu5B09iQIU8rD6EAU9pDP_4 Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Domain-Id: None Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Domain-Name: None Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Identity-Status: Confirmed Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Is-Admin-Project: True Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Domain-Id: default Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Domain-Name: Default Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Name: admin Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Role: reader,member,admin Aug 24 10:10:39.530317 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Roles: reader,member,admin Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85765b8a176a42c8b2b1e092bbcf9c4f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Tenant: admin Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Tenant-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Tenant-Name: admin Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User: admin Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Domain-Id: default Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Domain-Name: Default Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Id: deb4aa9488e54d0eafc940ddd57f345d Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Name: admin Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: method: > Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: exception: Flavor 42 could not be found. Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: action_args: {'id': '42'} Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:10:39.532426 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:39.533302 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:39.534451 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-7546b65a-ccbc-47b9-8b2a-f9c373dee6ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:10:39.535664 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-7546b65a-ccbc-47b9-8b2a-f9c373dee6ec admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015097 Aug 24 10:10:39.535664 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Aug 24 10:10:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:40.517342 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-fed0a952-9293-45c2-b270-a125964f10c7 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:40.518357 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-fed0a952-9293-45c2-b270-a125964f10c7 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 24 10:10:40.518757 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:10:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:41.064916 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-0cbf76de-3792-4ce4-907a-1ec162fcb6f8 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:41.070303 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.wsgi [None req-0cbf76de-3792-4ce4-907a-1ec162fcb6f8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-0cbf76de-3792-4ce4-907a-1ec162fcb6f8 admin admin] Request method failure captured: Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Accept: application/json Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Accept-Encoding: gzip, deflate Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Connection: keep-alive Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Content-Length: 0 Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Host: 10.222.0.30 Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Openstack-Api-Version: compute 2.90 Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Openstack-System-Scope: None Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: User-Agent: python-novaclient Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Auth-Token: gAAAAABjBfkg8CfJhu6cXGEVUBAC8ZaFUwnJcNFsy1b-sl70xseGVlxRdOx9MxS_4Xv8CdADP_WLidYL1wy_8gtKVYdFdC4ruCgio6SaSpysWw_vmnyMRugSuZy4laOXDBnR9pXeZYGnVenH5Qd32NrKyQ_uEiq7ALFLngq12dye9fKw297IxGM Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Domain-Id: None Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Domain-Name: None Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Identity-Status: Confirmed Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Is-Admin-Project: True Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Domain-Id: default Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Domain-Name: Default Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Name: admin Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Role: reader,member,admin Aug 24 10:10:41.071790 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Roles: reader,member,admin Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85765b8a176a42c8b2b1e092bbcf9c4f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Tenant: admin Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Tenant-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Tenant-Name: admin Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User: admin Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Domain-Id: default Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Domain-Name: Default Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Id: deb4aa9488e54d0eafc940ddd57f345d Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Name: admin Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: method: > Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: exception: Flavor 84 could not be found. Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: action_args: {'id': '84'} Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:10:41.073362 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:41.074372 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:41.075949 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-0cbf76de-3792-4ce4-907a-1ec162fcb6f8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:10:41.077201 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-0cbf76de-3792-4ce4-907a-1ec162fcb6f8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.413487 Aug 24 10:10:41.077201 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Aug 24 10:10:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:41.083560 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-175c3c5f-2b24-40b5-91fc-09b3543e6e4a admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:41.099380 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-175c3c5f-2b24-40b5-91fc-09b3543e6e4a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019366 Aug 24 10:10:41.099921 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Aug 24 10:10:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:10:41.109935 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-799668ea-13e9-4e64-a9c2-84c2ae581f02 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:41.124897 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-799668ea-13e9-4e64-a9c2-84c2ae581f02 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018918 Aug 24 10:10:41.125477 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Aug 24 10:10:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:10:41.134862 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-5717a8ae-4dcd-42b3-820e-f1e1eb4ad6ad admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:41.141379 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.wsgi [None req-5717a8ae-4dcd-42b3-820e-f1e1eb4ad6ad admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-5717a8ae-4dcd-42b3-820e-f1e1eb4ad6ad admin admin] Request method failure captured: Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Accept: application/json Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Accept-Encoding: gzip, deflate Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Connection: keep-alive Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Content-Length: 0 Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Host: 10.222.0.30 Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Openstack-Api-Version: compute 2.90 Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Openstack-System-Scope: None Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: User-Agent: python-novaclient Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Auth-Token: gAAAAABjBfkg8CfJhu6cXGEVUBAC8ZaFUwnJcNFsy1b-sl70xseGVlxRdOx9MxS_4Xv8CdADP_WLidYL1wy_8gtKVYdFdC4ruCgio6SaSpysWw_vmnyMRugSuZy4laOXDBnR9pXeZYGnVenH5Qd32NrKyQ_uEiq7ALFLngq12dye9fKw297IxGM Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Domain-Id: None Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Domain-Name: None Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Identity-Status: Confirmed Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Is-Admin-Project: True Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Domain-Id: default Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Domain-Name: Default Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Name: admin Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Role: reader,member,admin Aug 24 10:10:41.142887 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Roles: reader,member,admin Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85765b8a176a42c8b2b1e092bbcf9c4f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Tenant: admin Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Tenant-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Tenant-Name: admin Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User: admin Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Domain-Id: default Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Domain-Name: Default Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Id: deb4aa9488e54d0eafc940ddd57f345d Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Name: admin Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: method: > Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: exception: Flavor 84 could not be found. Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: action_args: {'id': '84'} Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:10:41.144539 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:41.145712 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:41.147029 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-5717a8ae-4dcd-42b3-820e-f1e1eb4ad6ad admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:10:41.148722 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-5717a8ae-4dcd-42b3-820e-f1e1eb4ad6ad admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012972 Aug 24 10:10:41.148722 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Wed Aug 24 10:10:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:42.136972 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-799668ea-13e9-4e64-a9c2-84c2ae581f02 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:42.138208 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-799668ea-13e9-4e64-a9c2-84c2ae581f02 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Aug 24 10:10:42.138680 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:10:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:42.675228 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-7809dc30-2773-4133-a0a0-a763a5e1ea54 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:42.680921 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.wsgi [None req-7809dc30-2773-4133-a0a0-a763a5e1ea54 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-7809dc30-2773-4133-a0a0-a763a5e1ea54 admin admin] Request method failure captured: Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Accept: application/json Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Accept-Encoding: gzip, deflate Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Connection: keep-alive Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Content-Length: 0 Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Host: 10.222.0.30 Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Openstack-Api-Version: compute 2.90 Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Openstack-System-Scope: None Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: User-Agent: python-novaclient Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Auth-Token: gAAAAABjBfkiWQPEKninQxj2bXhCIjqH_RI7ySSkefdgTJEOPdWT6s-fqnrrGDftY06Fe5YUPO80N-xJAAQkcMUSd8ZLycoRm1AVW-eKHji6HA6N-bQ-zyQQ3As2ojnpmGk83g0UwxVDf5-0HSocI9zhkO3_FC8F4euhCwSs5Sdsjiv_eMo2vHM Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Domain-Id: None Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Domain-Name: None Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Identity-Status: Confirmed Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Is-Admin-Project: True Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Domain-Id: default Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Domain-Name: Default Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Project-Name: admin Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Role: reader,member,admin Aug 24 10:10:42.682492 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Roles: reader,member,admin Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85765b8a176a42c8b2b1e092bbcf9c4f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Tenant: admin Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Tenant-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-Tenant-Name: admin Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User: admin Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Domain-Id: default Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Domain-Name: Default Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Id: deb4aa9488e54d0eafc940ddd57f345d Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: X-User-Name: admin Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: method: > Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: exception: Flavor 451 could not be found. Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: action_args: {'id': '451'} Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:10:42.683795 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:42.684577 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Aug 24 10:10:42.686878 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-7809dc30-2773-4133-a0a0-a763a5e1ea54 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:10:42.688778 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-7809dc30-2773-4133-a0a0-a763a5e1ea54 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.404780 Aug 24 10:10:42.688778 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Aug 24 10:10:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 10:10:42.694749 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-370d07e2-17cf-4049-a4d3-664eedd81024 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:42.709911 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-370d07e2-17cf-4049-a4d3-664eedd81024 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018779 Aug 24 10:10:42.710479 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Aug 24 10:10:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:10:42.720807 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:42.736923 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019718 Aug 24 10:10:42.740836 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Wed Aug 24 10:10:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:10:42.747992 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-f241d892-655e-4e49-a742-dc04625eb9df admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:42.754116 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.wsgi [None req-f241d892-655e-4e49-a742-dc04625eb9df admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-f241d892-655e-4e49-a742-dc04625eb9df admin admin] Request method failure captured: Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Accept: application/json Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Accept-Encoding: gzip, deflate Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Connection: keep-alive Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Content-Length: 0 Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Host: 10.222.0.30 Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Openstack-Api-Version: compute 2.90 Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Openstack-System-Scope: None Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: User-Agent: python-novaclient Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Auth-Token: gAAAAABjBfkiWQPEKninQxj2bXhCIjqH_RI7ySSkefdgTJEOPdWT6s-fqnrrGDftY06Fe5YUPO80N-xJAAQkcMUSd8ZLycoRm1AVW-eKHji6HA6N-bQ-zyQQ3As2ojnpmGk83g0UwxVDf5-0HSocI9zhkO3_FC8F4euhCwSs5Sdsjiv_eMo2vHM Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Domain-Id: None Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Domain-Name: None Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Identity-Status: Confirmed Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Is-Admin-Project: True Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Domain-Id: default Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Domain-Name: Default Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Project-Name: admin Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Role: reader,member,admin Aug 24 10:10:42.755619 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Roles: reader,member,admin Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85765b8a176a42c8b2b1e092bbcf9c4f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85765b8a176a42c8b2b1e092bbcf9c4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Tenant: admin Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Tenant-Id: 85765b8a176a42c8b2b1e092bbcf9c4f Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-Tenant-Name: admin Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User: admin Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Domain-Id: default Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Domain-Name: Default Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Id: deb4aa9488e54d0eafc940ddd57f345d Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: X-User-Name: admin Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: method: > Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: exception: Flavor 451 could not be found. Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: action_args: {'id': '451'} Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:10:42.757442 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:42.758574 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Aug 24 10:10:42.760210 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-f241d892-655e-4e49-a742-dc04625eb9df admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:10:42.761861 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-f241d892-655e-4e49-a742-dc04625eb9df admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012557 Aug 24 10:10:42.761861 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Aug 24 10:10:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 10:10:43.753291 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:43.754297 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 24 10:10:43.754686 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:10:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:44.300973 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-787ca141-c1b7-4a4f-9959-b1d0f64a55bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:44.457250 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-787ca141-c1b7-4a4f-9959-b1d0f64a55bd admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.562684 Aug 24 10:10:44.457739 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Aug 24 10:10:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:10:45.459327 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:45.460342 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 24 10:10:45.460745 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:10:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:45.989473 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-a97a31bd-669c-43ce-a21f-59c1845c227c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:46.085812 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-a97a31bd-669c-43ce-a21f-59c1845c227c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.485428 Aug 24 10:10:46.086369 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Aug 24 10:10:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:10:47.072674 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:47.073704 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 24 10:10:47.074099 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:10:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:47.613035 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-662489d1-2f9e-484a-b9d9-7bb9baec7de4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:47.803321 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-662489d1-2f9e-484a-b9d9-7bb9baec7de4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.587847 Aug 24 10:10:47.803796 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Aug 24 10:10:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:10:48.818177 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:48.818177 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 24 10:10:48.818177 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:10:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:49.341716 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-27166c3a-1b64-492c-9abe-9bb2c778780c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:10:49.423729 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-27166c3a-1b64-492c-9abe-9bb2c778780c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.470982 Aug 24 10:10:49.424224 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Wed Aug 24 10:10:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:10:50.434097 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:50.435166 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 10:10:50.435565 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:10:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:10:50.963838 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-6a2897cb-3b6a-4ff5-b01d-c74f433319e2 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:10:50.985015 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-6a2897cb-3b6a-4ff5-b01d-c74f433319e2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410195 Aug 24 10:10:50.985555 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Wed Aug 24 10:10:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:11:46.109592 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:46.110618 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-88ae36a6-a032-4503-9680-0eff711e6901 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 24 10:11:46.111028 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Wed Aug 24 10:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:11:46.122249 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:46.509456 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-e1a30400-21ca-4526-9506-6b60ee97d94d admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:46.530739 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-e1a30400-21ca-4526-9506-6b60ee97d94d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.413518 Aug 24 10:11:46.531286 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Wed Aug 24 10:11:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:11:46.552571 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:11:46.556300 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-0dbb5b12-3aa1-4cda-87ee-e1a00cd3ade9 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:46.563883 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-0dbb5b12-3aa1-4cda-87ee-e1a00cd3ade9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012772 Aug 24 10:11:46.564407 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Wed Aug 24 10:11:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:46.576821 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-7ebf6518-8797-483a-8485-802cb21bd886 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:46.584884 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-7ebf6518-8797-483a-8485-802cb21bd886 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011880 Aug 24 10:11:46.585412 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Wed Aug 24 10:11:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:46.597446 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-fc8a693f-2af6-4187-8ab6-e8b20be0c12e admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:46.605334 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-fc8a693f-2af6-4187-8ab6-e8b20be0c12e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011513 Aug 24 10:11:46.606010 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Wed Aug 24 10:11:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:11:46.617757 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-74c10185-b24b-47c9-ae4b-80a467ed25e7 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:11:46.626333 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-74c10185-b24b-47c9-ae4b-80a467ed25e7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012217 Aug 24 10:11:46.626861 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Wed Aug 24 10:11:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:14:55.190844 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-fc8a693f-2af6-4187-8ab6-e8b20be0c12e admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:55.191860 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-fc8a693f-2af6-4187-8ab6-e8b20be0c12e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Aug 24 10:14:55.192257 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:14:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:55.336140 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_api:SELECT=6 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:14:55.497542 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-c85b0f83-9759-414e-8f7a-ea3ee22642db admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:55.500180 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:55.500180 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: warnings.warn(msg) Aug 24 10:14:55.501436 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-c85b0f83-9759-414e-8f7a-ea3ee22642db admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:55.501916 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-c85b0f83-9759-414e-8f7a-ea3ee22642db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:55.502344 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-c85b0f83-9759-414e-8f7a-ea3ee22642db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:55.503101 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-c85b0f83-9759-414e-8f7a-ea3ee22642db admin admin] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:55.503535 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-c85b0f83-9759-414e-8f7a-ea3ee22642db admin admin] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:55.503944 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-c85b0f83-9759-414e-8f7a-ea3ee22642db admin admin] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:55.539782 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-c85b0f83-9759-414e-8f7a-ea3ee22642db admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204986 Aug 24 10:14:55.540367 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Aug 24 10:14:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:14:56.393005 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-fc8a693f-2af6-4187-8ab6-e8b20be0c12e admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:56.394031 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-fc8a693f-2af6-4187-8ab6-e8b20be0c12e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002417 Aug 24 10:14:56.394430 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:14:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:56.588675 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-11270a92-106d-4cc0-b7a4-876b4e06d752 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:14:56.591098 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:14:56.591098 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: warnings.warn(msg) Aug 24 10:14:56.592201 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-11270a92-106d-4cc0-b7a4-876b4e06d752 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:56.592674 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-11270a92-106d-4cc0-b7a4-876b4e06d752 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:56.593130 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-11270a92-106d-4cc0-b7a4-876b4e06d752 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:56.593847 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-11270a92-106d-4cc0-b7a4-876b4e06d752 admin admin] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:14:56.594285 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-11270a92-106d-4cc0-b7a4-876b4e06d752 admin admin] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:14:56.594695 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-11270a92-106d-4cc0-b7a4-876b4e06d752 admin admin] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:14:56.614092 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-11270a92-106d-4cc0-b7a4-876b4e06d752 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081448 Aug 24 10:14:56.614652 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Aug 24 10:14:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:15:07.880209 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-fc8a693f-2af6-4187-8ab6-e8b20be0c12e admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:07.881249 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-fc8a693f-2af6-4187-8ab6-e8b20be0c12e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 24 10:15:07.881654 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:15:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:08.031520 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_cell0:SELECT=4 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:08.032335 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_cell1:SELECT=4 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:08.033051 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_api:SELECT=8 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:08.085636 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-5cfa90b7-d90b-42f3-9d09-aa5463514a50 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:08.088078 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:15:08.088078 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: warnings.warn(msg) Aug 24 10:15:08.089181 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-5cfa90b7-d90b-42f3-9d09-aa5463514a50 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:08.089648 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-5cfa90b7-d90b-42f3-9d09-aa5463514a50 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:08.090070 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-5cfa90b7-d90b-42f3-9d09-aa5463514a50 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:08.090780 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-5cfa90b7-d90b-42f3-9d09-aa5463514a50 admin admin] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:08.091219 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-5cfa90b7-d90b-42f3-9d09-aa5463514a50 admin admin] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:08.091628 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-5cfa90b7-d90b-42f3-9d09-aa5463514a50 admin admin] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:08.118156 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-5cfa90b7-d90b-42f3-9d09-aa5463514a50 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091071 Aug 24 10:15:08.118746 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Aug 24 10:15:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:15:08.975731 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-fc8a693f-2af6-4187-8ab6-e8b20be0c12e admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:08.976774 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-fc8a693f-2af6-4187-8ab6-e8b20be0c12e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 24 10:15:08.977215 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Wed Aug 24 10:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:09.171590 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-4dc53508-f885-42dc-9a94-c125604a5538 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:09.174659 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:15:09.174659 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: warnings.warn(msg) Aug 24 10:15:09.175813 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-4dc53508-f885-42dc-9a94-c125604a5538 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:09.176300 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-4dc53508-f885-42dc-9a94-c125604a5538 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:09.176732 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-4dc53508-f885-42dc-9a94-c125604a5538 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:09.177526 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-4dc53508-f885-42dc-9a94-c125604a5538 admin admin] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:09.177975 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-4dc53508-f885-42dc-9a94-c125604a5538 admin admin] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:09.178391 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-4dc53508-f885-42dc-9a94-c125604a5538 admin admin] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:09.199897 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-4dc53508-f885-42dc-9a94-c125604a5538 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082558 Aug 24 10:15:09.200390 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Wed Aug 24 10:15:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:16:05.524637 dv-cinder-854271-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 10:16:05.525238 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: Wed Aug 24 10:16:05 2022 - graceful shutdown triggered... Aug 24 10:16:05.525669 dv-cinder-854271-2-iscsi devstack@n-api.service[106252]: Gracefully killing worker 1 (pid: 106252)... Aug 24 10:16:05.526558 dv-cinder-854271-2-iscsi devstack@n-api.service[106253]: Gracefully killing worker 2 (pid: 106253)... Aug 24 10:16:06.526130 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: worker 1 buried after 1 seconds Aug 24 10:16:06.526679 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: worker 2 buried after 1 seconds Aug 24 10:16:06.526679 dv-cinder-854271-2-iscsi devstack@n-api.service[106251]: goodbye to uWSGI. Aug 24 10:16:06.527739 dv-cinder-854271-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 10:16:06.528296 dv-cinder-854271-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 10:16:06.531275 dv-cinder-854271-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 10:16:06.540811 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 10:16:06.543411 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 10:16:06 2022] *** Aug 24 10:16:06.543411 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 10:16:06.543411 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 10:16:06.543411 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: nodename: dv-cinder-854271-2-iscsi Aug 24 10:16:06.543411 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: machine: x86_64 Aug 24 10:16:06.543411 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: clock source: unix Aug 24 10:16:06.543411 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: pcre jit disabled Aug 24 10:16:06.543411 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: detected number of CPU cores: 4 Aug 24 10:16:06.543411 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: current working directory: / Aug 24 10:16:06.543411 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: detected binary path: /usr/bin/uwsgi-core Aug 24 10:16:06.544653 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: your processes number limit is 47680 Aug 24 10:16:06.544653 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: your memory page size is 4096 bytes Aug 24 10:16:06.544653 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: detected max file descriptor number: 2048 Aug 24 10:16:06.544653 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: lock engine: pthread robust mutexes Aug 24 10:16:06.544653 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: thunder lock: enabled Aug 24 10:16:06.544653 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 10:16:06.544653 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 10:16:06.584828 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: Python main interpreter initialized at 0x5602cc6e69c0 Aug 24 10:16:06.584828 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: python threads support enabled Aug 24 10:16:06.584828 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: your server socket listen backlog is limited to 100 connections Aug 24 10:16:06.584828 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: your mercy for graceful operations on workers is 90 seconds Aug 24 10:16:06.585276 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 10:16:06.585276 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: *** Operational MODE: preforking *** Aug 24 10:16:06.585495 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: *** uWSGI is running in multiple interpreter mode *** Aug 24 10:16:06.585495 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: spawned uWSGI master process (pid: 121259) Aug 24 10:16:06.585691 dv-cinder-854271-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 10:16:06.588453 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: spawned uWSGI worker 1 (pid: 121270, cores: 1) Aug 24 10:16:06.588808 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: spawned uWSGI worker 2 (pid: 121271, cores: 1) Aug 24 10:16:06.588987 dv-cinder-854271-2-iscsi devstack@n-api.service[121259]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 10:16:07.271682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 10:16:07.272303 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 10:16:08.451813 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:16:08.451813 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: from cryptography.utils import int_from_bytes Aug 24 10:16:08.452470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:16:08.452470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: from cryptography.utils import int_from_bytes Aug 24 10:16:08.453135 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:16:08.453135 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: from cryptography.utils import int_from_bytes Aug 24 10:16:08.453567 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:16:08.453567 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: from cryptography.utils import int_from_bytes Aug 24 10:16:10.903622 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:16:10.904224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:16:10.904547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:16:10.904754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:16:10.905207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:16:10.905291 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:16:10.905371 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:16:10.905656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.905766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:16:10.905857 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.906038 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:16:10.906123 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.906195 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:16:10.906438 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.906550 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.906893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.907002 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.907228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.907341 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.907557 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.907672 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.907886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.908043 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.908219 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.908384 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.908483 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.908690 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.908795 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.909049 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.909239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854271-2-iscsi {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.909391 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.909544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.909698 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.909847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.909996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.910137 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.910286 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854271-2-iscsi {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.910442 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.910592 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.910741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.910911 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.911097 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.911269 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.911428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.911579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.911815 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.911991 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.912141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.913386 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.913615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.913615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.914041 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.914274 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.914504 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.914721 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.914939 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.915159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.915376 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.915616 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.915908 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.916117 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.916325 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.916542 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.916759 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.917004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.917224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.917442 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.917670 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.917670 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.918084 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854271-2-iscsi {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.918306 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.918511 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.918511 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.918887 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854271-2-iscsi {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.919159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.919451 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.919451 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.920420 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.920579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.920737 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.920737 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.921075 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.921235 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.921773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.921938 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.922090 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.922246 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.922397 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.922551 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.922834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.922994 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.923144 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.923312 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.923457 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.923605 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.923748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.923896 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.924044 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.924267 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.924485 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.924642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.924796 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.925023 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.925168 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.925319 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.925483 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.925678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.925827 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.925978 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.926129 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.926287 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.926438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.926587 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.926736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.926878 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.927033 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.927175 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.927339 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.927481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.927630 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.927778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.927930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.928084 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.928227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.928376 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.928527 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.928683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.928826 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.929024 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.929176 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.929319 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.929472 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.929620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.929770 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.930079 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.930498 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.930658 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.930810 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.930961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.931110 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.931262 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.931436 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.931776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.932090 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.932241 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.932392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.932544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.932693 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.932875 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.933128 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.933287 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.934030 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.934030 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.934212 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.934212 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.934366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.934977 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.935124 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.935252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.935364 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.935493 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.935579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.935657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.935735 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.935812 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.935894 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.935975 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936054 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936124 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936346 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936425 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936496 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936718 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.936998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937283 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937431 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937500 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937569 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937644 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937724 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937802 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937879 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.937949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938018 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938086 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938164 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938235 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938315 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938618 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938695 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938860 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.938933 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939010 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939087 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939240 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939471 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939550 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939627 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939698 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939783 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939852 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.939931 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.940008 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.940078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.940162 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.941038 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.941208 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.941355 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.941502 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.941654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.941805 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.941957 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.942106 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.942258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.942407 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.942555 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.942697 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.942837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.942983 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.943140 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.943297 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.943445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.943593 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.943741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.943908 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.944060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.944228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.944387 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.944540 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.944688 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.944840 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.945016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.945165 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.945306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.945451 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.945592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.945745 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.945897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.946037 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.946191 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.946332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.946471 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.946619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.946771 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.946920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.947067 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.947214 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.947364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.947505 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.947644 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.947783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.947940 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.948081 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.948239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.948390 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.948608 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.949300 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.949554 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.949718 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.949873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.950024 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.950771 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.950771 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.951058 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.951214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.951369 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.951517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.951666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.951814 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.951969 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.951969 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:16:10.952253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.952396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.952536 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.952675 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.952822 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.953001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.953155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.953308 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.953449 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.953588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.953729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.953877 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.954026 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.954181 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.954334 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.954485 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.954640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.954788 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.954946 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.955087 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.955226 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.955366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.955515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.955665 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.955813 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.955962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.956112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.956260 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.956402 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.956551 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.956692 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.956842 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.957048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.957198 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.957346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.957497 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.957645 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.957786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.957925 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.958064 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.958203 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.958425 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.958571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.958723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.958862 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.959002 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.959150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.959299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.959454 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.959597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.959745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.959893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.960047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.960196 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.960337 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.960484 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.960643 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.960790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.960970 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.961113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.961253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.961400 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.961549 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.961690 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.961843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.961984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.962124 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.962271 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.962418 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.962570 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.962721 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.962868 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.963019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.963161 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.963300 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.963452 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.963593 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.963755 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.963896 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.964042 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.964266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.964430 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.964583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.964733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.964943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.964943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.965228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.965382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.965530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.965670 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.965878 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.966019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.966167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.966376 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.966528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.966687 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.966831 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.966981 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.967131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.967318 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.967468 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.967658 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.967815 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.967965 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.968116 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.968306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.968455 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.968613 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.968752 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.968958 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.969123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.969273 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.969421 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.969587 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.969744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.969892 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.970053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.970277 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.970422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.970569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.970721 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.970869 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.971025 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.971167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.971305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.971452 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.971592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.971747 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.971889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.972063 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.972219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.972360 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.972505 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.972666 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.972815 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.973141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.973301 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.973455 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.973603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.973754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.973896 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.974036 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.974177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.974327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.974477 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.974619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.974776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.974925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.975066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.975215 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.975366 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.975514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.975662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.975804 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.975944 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.976084 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.976240 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.976390 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.976542 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.976683 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.976823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.977060 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.977229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.977896 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.978052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.978052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.978326 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.978483 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.978626 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.978818 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.978973 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.979125 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.979266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.979417 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.979560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.979717 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.979918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.980063 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.980204 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.980359 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.980510 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.980715 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.980894 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.981054 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.981213 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.981920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.982136 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.982284 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.982426 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.982568 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.982719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.982861 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.983001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.983152 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.983300 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.983440 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.983591 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.983750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.983899 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.984040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.984180 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.984333 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.984554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.984554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.984832 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.984832 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.985155 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.985155 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.985432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.985432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.985712 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.985851 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.985998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.986148 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.986288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.986434 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.986581 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.986722 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.986869 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.987099 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.987247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.987394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.987553 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.987694 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.987843 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.987992 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.988141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.988281 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.988428 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.988576 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.988718 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.988891 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.989049 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.989199 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.989358 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.989522 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.989677 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.989836 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.989991 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.990138 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.990291 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.990439 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.990593 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.990740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.990886 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.991043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.991192 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.991969 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.992585 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.992755 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.992923 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.993095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.993245 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.993399 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.993548 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.993701 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.993857 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.994005 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.994258 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.994465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.994628 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.994776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.994932 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.995078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.995226 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.995373 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.995527 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.995673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.995834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.995981 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.996398 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.996547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.996547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.996872 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.997655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.997822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.997822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.998115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.998271 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.998425 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.998586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.998740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.998894 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.999048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.999048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.999358 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.999514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.999660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:10.999660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.000004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.000157 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.000331 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.000828 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.001141 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.001312 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.001463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.001617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.001790 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.001946 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.002100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.002254 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.002408 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.002557 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.002716 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.002870 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.003017 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.003170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.003323 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.003482 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.004117 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.004304 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.004457 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.004615 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.004763 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.004966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.005130 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.005278 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.005432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.005588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.005743 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.005901 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.006048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.006195 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.006353 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.006501 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.006655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.006812 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.006959 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.007105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.007258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.007413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.007569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.007717 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.007863 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.008009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.008155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.008319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.008476 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.008632 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.008788 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.008974 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.009122 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.009280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.009441 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.009589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.009734 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.009881 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.010026 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.010180 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.010351 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.010500 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.010704 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.010842 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.010939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.011077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.011223 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.011324 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.011416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.011507 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.011592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.011678 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.011762 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.011833 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.011922 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.012013 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.012104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.012202 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.012286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.012438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.012601 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.012691 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.012772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.012880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.012957 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013039 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013163 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013390 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013501 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013608 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013899 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.013999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.014167 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.014251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.014443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.014536 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.014772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.014864 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.015105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.015410 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.015501 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.015753 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.015844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.016075 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.016166 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.016417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.016567 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.016709 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.016837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.017045 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.017153 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.017386 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.017481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.017696 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.017793 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.018010 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.018115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.018330 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.018436 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.018643 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.018749 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.018957 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.019057 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.019269 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.019362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.019583 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.019682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.019891 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.019982 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.020202 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.020301 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.020514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.020616 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.020823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.020946 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.021158 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.021249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.021472 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.021571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.021786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.021884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.022095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.022238 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.022414 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.022506 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.022725 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.022816 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.023033 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.023131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.023342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.023443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.023652 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.023757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.024002 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.024102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.024312 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.024403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.024623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.024714 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.024957 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.025070 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.025308 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.025407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.025625 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.025716 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.025943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.026048 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.026276 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.026368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.026595 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.026771 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.026887 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.026996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.027290 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.027391 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.027571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.027763 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.027930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.028105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.028298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.028458 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.028607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.028767 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.028975 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.029233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.029549 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.029713 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.029863 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.030011 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.030167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.030315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.030471 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.030627 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.030783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.030930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.031108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.031259 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.031406 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.031561 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.031717 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.031884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.032033 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.032291 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.032610 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.032957 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.033191 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.033361 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.033585 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.033769 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.033896 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.034108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.034215 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.034454 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.034577 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.034794 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.034898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.035117 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.035228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.035430 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.035534 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.035748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.035851 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.036065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.036185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.036375 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.036478 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.036715 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.036833 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.037158 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.037484 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.037918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.038021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.038207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.038320 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.038521 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.038631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.038810 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.038910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.039150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.039319 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.039473 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.039637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.039796 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.039947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.040097 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.040255 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.040416 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.040580 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.040732 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.040912 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.041070 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.041221 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.041391 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.041583 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.041736 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.041911 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.042076 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.042227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.042387 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.042550 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.042701 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.042859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.043009 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.043167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.043331 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.043483 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.043642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.044336 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.044513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.044706 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.044937 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.045124 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.045391 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.045592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.045592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.045949 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.046103 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.046263 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.046438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.046602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.046902 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.047082 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.047236 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.047394 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.047548 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.047710 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.047862 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.048022 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.048174 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.048324 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.048475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.048637 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.048803 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.048997 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.049150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.049317 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.049484 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.049643 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.049818 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.049984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.050143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.050301 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.050453 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.050617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.050783 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.050941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.051092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.051242 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.051392 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.051543 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.051702 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.051864 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.052039 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.052195 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.052352 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.052504 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.052667 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.052821 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.053035 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.053188 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.053340 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.053500 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.053659 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.053821 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.053992 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.054144 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.054294 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.054460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.054621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.054772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.054941 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.055093 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.055257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.055471 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.055633 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.055793 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.055972 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.056124 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.056274 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.056438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.056590 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.056740 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.056935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.057104 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.057266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.057425 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.057584 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.057743 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.057919 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.058092 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.058253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.058406 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.058557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.058717 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.058877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.059039 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.059206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.059365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.059572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.059738 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.059892 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.060042 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.060218 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.060371 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.060521 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.060521 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.060816 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.061028 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.061191 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.061343 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.061493 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.061650 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.061808 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.061974 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.062144 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.062296 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.062455 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.062614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.062765 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.062925 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.063077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.063245 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.063406 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.063564 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.063715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.063875 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.064033 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.064195 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.064346 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.064495 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.064655 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.064813 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.064994 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.065156 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.065308 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.065466 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.065626 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.065778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.065927 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.066085 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.066255 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.066415 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.066581 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.066733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.066890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.067041 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.067197 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.067350 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.067512 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.067663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.067820 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.067970 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.068120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.068293 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.068466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.068619 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.068778 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.069000 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.069163 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.069328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.069489 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.069648 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.069799 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.069949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.070107 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.070325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.070479 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.070630 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.070788 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.070939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.071089 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.071255 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.071408 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.071558 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.071720 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.071884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.072036 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.072195 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.072357 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.072515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.072667 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.072827 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.072985 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.073106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.073200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.073286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.073382 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.073499 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.073634 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.073817 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.073941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.074146 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.074257 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.074465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.074557 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.074798 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.074890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.075680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.075824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.075996 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.076279 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.076372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.076655 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.076754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.077045 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.077229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.077375 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.077553 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.077700 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.077934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.078097 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.078248 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.078407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.078579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.078731 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.078892 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.079057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.079207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.079356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.079507 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.079665 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.079831 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.079983 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.080143 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.080294 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.080444 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.080594 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.080753 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.080925 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.081105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.081264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.081415 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.081579 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.081730 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.081887 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.082059 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.082217 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.082368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.082533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.082684 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.082834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.082983 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.083151 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.083311 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.083476 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.083628 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.083778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.083936 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.084088 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.084239 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.084399 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.084565 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.084718 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.084922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.085105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.085285 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.085446 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.085598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.085748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.085906 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.086058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.086217 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.086377 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.086528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.086703 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.086855 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.087005 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.087200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.087370 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.087531 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.087682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.087832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.088000 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.088166 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.088318 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.088478 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.088631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.088781 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.088972 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.089127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.089292 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.089451 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.089602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.089760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.089925 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.090077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.090228 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.090378 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.090529 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.090706 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.091511 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.091678 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.091850 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.092028 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.092244 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.092399 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.092563 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.092563 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.092888 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.093051 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.093214 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.093214 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.093513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.093672 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.093839 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.094004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.094156 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.094321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.094474 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.094624 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.094775 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.094933 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.095084 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.095247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.095407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.095565 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.095724 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.095884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.096046 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.096206 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.096365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.096524 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.096675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.096826 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.096999 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.096999 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.097181 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.097275 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.097426 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.097518 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.097651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.097740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.097824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.098037 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.098203 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.098362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.098531 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.098687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.098845 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.099019 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.099178 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.099330 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.099491 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.099654 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.099812 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.099964 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.100115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.100289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.100452 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.100612 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.100763 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.100951 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.101120 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.101281 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.101440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.101619 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.101804 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.101965 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.102118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.102279 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.102432 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.102606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.102773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.102926 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.103092 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.103244 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.103402 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.103553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.103715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.103879 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.104047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.104209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.104370 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.104532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.104690 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.104876 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.105037 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.105200 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.105359 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.105517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.105745 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.106010 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.106186 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.106385 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.106572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.106973 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.107153 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.107354 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.107587 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.107748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.108069 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.108239 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.108486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.108642 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.108802 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.109019 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.109176 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.109338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.109502 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.109662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.109821 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.109973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.110123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.110282 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.110521 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.110691 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.110843 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.111050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.111381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.111554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.111708 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.111968 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.112140 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.112357 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.112516 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.112680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.112924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.113099 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.113297 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.113470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.113632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.113831 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.113992 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.114249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.114414 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.114573 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.114871 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.115041 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.115203 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.115511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.115671 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.115824 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.115983 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.116137 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.116440 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.116599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.116841 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.117094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.117273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.117457 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.117616 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.117778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.118054 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.118223 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.118386 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.118538 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.118719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.118888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.119040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.119204 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.119363 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.119514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.119676 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.119835 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.119998 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.120171 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.120327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.120486 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.120637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.120800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.120994 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.121434 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.121594 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.121756 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.121947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.122114 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.122332 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.122519 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.122681 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.122833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.122984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.123143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.123310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.123470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.123629 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.123789 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.123942 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.124101 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.124267 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.124427 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.124591 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.124750 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.124954 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.125123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.125295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.125457 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.125616 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.125769 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.125920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.126070 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.126232 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.126384 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.126536 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.126698 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.126856 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.127019 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.127179 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.127332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.127490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.127649 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.127826 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.127996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.128162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.128314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.128466 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.128626 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.128786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.128985 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.129140 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.129291 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.129442 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.129592 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.129743 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.129902 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.130054 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.130216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.130369 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.130529 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.130714 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.130867 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.131027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.131186 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.131343 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.131495 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.131660 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.131821 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.131821 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.132116 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.132268 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.132419 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.132580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.132742 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.132931 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.133102 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.133253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.133422 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.133584 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.133743 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.133895 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.134054 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.134205 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.134366 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.134525 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.134691 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.134861 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.135020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.135179 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.135179 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.135505 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.135659 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.135818 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.135980 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.136139 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.136301 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.136460 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.136460 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.136791 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.136985 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.137149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.137309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.137468 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.138164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.138319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.138478 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.138641 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.138800 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.138959 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.139116 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.139116 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.139424 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.139597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.139756 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.139910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.140071 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.140251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.140414 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.140652 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.140818 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.140995 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.141121 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.141217 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.141319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.141419 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.141507 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.141608 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.141757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.141922 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.142086 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.142254 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.142413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.142573 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.142733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.142897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.143066 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.143235 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.143389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.143540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.143698 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.143858 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.144011 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.144169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.144329 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.144480 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.144631 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.144796 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.145015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.145185 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.145366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.145519 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.145670 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.145835 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.145996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.146150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.146308 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.146468 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.146635 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.146788 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.146939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.147109 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.147270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.147423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.147587 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.147739 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.147897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.148058 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.148217 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.148369 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.148532 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.148692 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.148849 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.149026 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.149187 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.149339 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.149505 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.149658 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.149816 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.149968 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.150119 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.150281 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.150440 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.150598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.150751 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.150901 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.151076 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.151253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.151407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.151579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.151735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.151886 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.152037 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.152198 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.152359 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.152524 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.152675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.152834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.153040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.153232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.153418 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.153571 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.153779 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.153951 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.154121 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.154274 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.154425 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.154576 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.154734 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.154916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.155086 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.155264 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.155443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.155596 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.155754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.155913 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.156078 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.156231 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.156398 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.156552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.156713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.156910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.157081 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.157246 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.157407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.157566 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.157729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.157896 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.158054 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.158206 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.158356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.158534 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.158685 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.158816 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.158932 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.159049 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.159161 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.159289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.159422 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.159569 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.159727 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.159879 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.160055 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.160185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.160373 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.160496 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.160713 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.160847 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.161060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.169665 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.169838 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.170061 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.170296 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.170465 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.170580 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.170671 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.170671 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.170855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.170942 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171034 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171213 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171309 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171479 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171656 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171847 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.171932 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172108 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172255 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172357 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172444 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172528 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172612 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172694 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172899 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.172986 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.173070 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.173167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.173262 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.173356 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.173442 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.173578 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.173716 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.173850 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.173945 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174094 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174373 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174459 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174551 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174737 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174829 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.174920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.175158 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.175247 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.175339 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.175424 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.175508 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.175600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.175694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.175787 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.175873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.175964 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.176050 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.176143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.176237 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.176323 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.176415 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.176509 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.176601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.176694 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.176787 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.176951 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177056 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177156 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:16:11.177249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.177922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.178436 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.178436 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.178770 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.179106 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.179512 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.179836 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.180200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:16:11.180392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:16:11.237105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO dbcounter [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Registered counter for database nova_api Aug 24 10:16:11.245426 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO dbcounter [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Registered counter for database nova_api Aug 24 10:16:11.258185 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_db.sqlalchemy.engines [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:16:11.265781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writer thread running {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:16:11.267186 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_db.sqlalchemy.engines [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:16:11.274092 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writer thread running {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:16:11.322893 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.context [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),21af12e8-eed5-417b-a9f1-00673b481ea2(cell1) {{(pid=121270) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 10:16:11.327635 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:11.328112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:11.329722 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:11.330475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:11.330936 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:11.332682 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.context [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),21af12e8-eed5-417b-a9f1-00673b481ea2(cell1) {{(pid=121271) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 10:16:11.332914 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:11.334909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO dbcounter [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Registered counter for database nova_cell0 Aug 24 10:16:11.336786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:11.337289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:11.338858 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:11.338973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO dbcounter [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Registered counter for database nova_cell1 Aug 24 10:16:11.339734 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:16:11.340183 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:16:11.343254 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:16:11.345310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO dbcounter [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Registered counter for database nova_cell0 Aug 24 10:16:11.347046 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_db.sqlalchemy.engines [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:16:11.348816 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_db.sqlalchemy.engines [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:16:11.349614 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO dbcounter [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Registered counter for database nova_cell1 Aug 24 10:16:11.354486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writer thread running {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:16:11.356903 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_db.sqlalchemy.engines [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:16:11.357406 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writer thread running {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:16:11.359173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_db.sqlalchemy.engines [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:16:11.365588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writer thread running {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:16:11.368206 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writer thread running {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:16:11.507033 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO dbcounter [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Registered counter for database nova_cell0 Aug 24 10:16:11.515198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_db.sqlalchemy.engines [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:16:11.520246 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writer thread running {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:16:11.521790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO dbcounter [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Registered counter for database nova_cell0 Aug 24 10:16:11.528401 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_db.sqlalchemy.engines [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:16:11.533769 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writer thread running {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:16:11.854782 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: WARNING keystonemiddleware.auth_token [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:16:11.856814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: WARNING keystonemiddleware.auth_token [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:16:11.862744 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: WARNING keystonemiddleware.auth_token [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:16:11.864153 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: WARNING keystonemiddleware.auth_token [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:16:12.211339 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: WARNING keystonemiddleware.auth_token [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:16:12.217123 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: WARNING keystonemiddleware.auth_token [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 10:16:12.218786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: WARNING keystonemiddleware.auth_token [None req-a4dda716-2285-48e5-811f-7ee60a2d2ac6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:16:12.223682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: WARNING keystonemiddleware.auth_token [None req-006ea7d5-bdd7-4426-a353-fb839357a392 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 10:16:12.224116 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602cc6e69c0 pid: 121271 (default app) Aug 24 10:16:12.229283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602cc6e69c0 pid: 121270 (default app) Aug 24 10:16:49.493651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=3 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:49.494634 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=3 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:49.495866 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=3 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:49.496668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=3 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:50.848322 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-48cee489-0623-451e-b73a-52df70600f23 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] Action: 'create', calling method: .version_select at 0x7f0af61125e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-594294510", "metadata": {"Type": "work"}}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:16:53.184254 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-48cee489-0623-451e-b73a-52df70600f23 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.702359 Aug 24 10:16:53.185936 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1156 bytes} [Wed Aug 24 10:16:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3706 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 10:16:53.629012 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4bd4d064-cbe9-495f-8d63-d2f99b9106d7 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] Calling method '.version_select at 0x7f0af623f1f0>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:53.667974 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:53.669253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:53.670566 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:53.671564 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:16:54.108193 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4bd4d064-cbe9-495f-8d63-d2f99b9106d7 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c" status: 200 len: 352 microversion: 2.1 time: 0.909671 Aug 24 10:16:54.109520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 1/2] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:16:53 2022] GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c => generated 352 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:16:55.133560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f50c87e6-5342-44bd-864a-36fa05efe6c3 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] Calling method '.version_select at 0x7f0af5fe64c0>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:55.552923 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f50c87e6-5342-44bd-864a-36fa05efe6c3 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c" status: 200 len: 353 microversion: 2.1 time: 0.433639 Aug 24 10:16:55.553317 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:16:55 2022] GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c => generated 353 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:55.566879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3934331d-bdf3-47ae-a0d3-18957b6647b5 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] Calling method '.version_select at 0x7f0af603e790>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:55.977699 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3934331d-bdf3-47ae-a0d3-18957b6647b5 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c" status: 200 len: 353 microversion: 2.1 time: 0.414927 Aug 24 10:16:55.978725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:16:55 2022] GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c => generated 353 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:55.999030 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d8456f87-a144-4266-b547-18f0415705b6 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] Calling method '.version_select at 0x7f0af5fe6b80>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:56.265891 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d8456f87-a144-4266-b547-18f0415705b6 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c" status: 202 len: 0 microversion: 2.1 time: 0.271442 Aug 24 10:16:56.267980 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Aug 24 10:16:55 2022] DELETE /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:16:56.279873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c76ebc08-3d2b-494c-9b8e-4c1bae5e382d tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] Calling method '.version_select at 0x7f0af603e3a0>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:56.379102 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c76ebc08-3d2b-494c-9b8e-4c1bae5e382d tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c" status: 200 len: 352 microversion: 2.1 time: 0.106678 Aug 24 10:16:56.380252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:16:56 2022] GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:16:57.397105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f500d882-7691-4c53-96a2-51c1b0b4e6f3 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] Calling method '.version_select at 0x7f0af5fff280>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:16:57.455235 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-f500d882-7691-4c53-96a2-51c1b0b4e6f3 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] HTTP exception thrown: Volume 747833f4-0359-4006-849b-cac681bf5c7c could not be found. Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f500d882-7691-4c53-96a2-51c1b0b4e6f3 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] Request method failure captured: Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c HTTP/1.1 Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfqRiYNk8RMl4swn1hmtjRqzgrWsz0LbgtfC5jxUIFyQWYnT541Cwe7qjiW6oJo9vMJrZ9nFDCLi_2iwaV0xAnDAGH6halSqCU5F5jXnDmPOtTG8yWyg9cDAvF7RUICjul4aKUfOfaUFm895OY_MscTwX-uTwIBITQrp1FIWcLhf-tY Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 1f6e168f1f704ea79da9d9398e01cfac Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-VolumesGetTestJSON-4141902 Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:16:57.458819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f6e168f1f704ea79da9d9398e01cfac", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f6e168f1f704ea79da9d9398e01cfac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f6e168f1f704ea79da9d9398e01cfac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f6e168f1f704ea79da9d9398e01cfac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-VolumesGetTestJSON-4141902 Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 1f6e168f1f704ea79da9d9398e01cfac Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-VolumesGetTestJSON-4141902 Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-VolumesGetTestJSON-4141902-project Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: c63498977927450493f25b373da0cec9 Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-VolumesGetTestJSON-4141902-project Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Volume 747833f4-0359-4006-849b-cac681bf5c7c could not be found. Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '747833f4-0359-4006-849b-cac681bf5c7c'} Aug 24 10:16:57.460177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 747833f4-0359-4006-849b-cac681bf5c7c could not be found. (HTTP 404) (Request-ID: req-83c2b31c-27c5-49f1-9919-c104ffc7983b) Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:16:57.461118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:16:57.462282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 747833f4-0359-4006-849b-cac681bf5c7c could not be found. Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 10:16:57.463785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 747833f4-0359-4006-849b-cac681bf5c7c could not be found. Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 747833f4-0359-4006-849b-cac681bf5c7c could not be found. Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f500d882-7691-4c53-96a2-51c1b0b4e6f3 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] Returning 404 to user: Volume 747833f4-0359-4006-849b-cac681bf5c7c could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:16:57.465004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f500d882-7691-4c53-96a2-51c1b0b4e6f3 tempest-VolumesGetTestJSON-4141902 tempest-VolumesGetTestJSON-4141902-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c" status: 404 len: 109 microversion: 2.1 time: 0.070599 Aug 24 10:16:57.465821 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:16:57 2022] GET /compute/v2.1/os-volumes/747833f4-0359-4006-849b-cac681bf5c7c => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:17:03.250727 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1368937189", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:03.505965 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] validate_networks() for [('cd8e81e0-99a4-4b0d-840b-c6d4a60fe43d', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:06.241331 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-83546666-84e1-4f9f-8983-a431d62cfd83 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: .version_select at 0x7f0af5fffaf0>, body: {"keypair": {"name": "tempest-keypair-1333985081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5NDSV+O6MmIqzpJ1WA/g0zJkiB5OFFiqbdTQ1hJcE6dPUuigFXICTuEyARVe4XABuleyAb7OcAQKXKvf9SbM/DD4dh41/DQn1p05R4bKphYxAEar9Yaea7J9MWLAOAiw=="}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:06.378490 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-83546666-84e1-4f9f-8983-a431d62cfd83 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for project 8824664cdd104c308141264985a547a1. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:06.396282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-83546666-84e1-4f9f-8983-a431d62cfd83 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for user c94c65ae14e94796a3b3bd0bb29a91b9 and project 8824664cdd104c308141264985a547a1. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:06.617655 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-83546666-84e1-4f9f-8983-a431d62cfd83 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.758042 Aug 24 10:17:06.626242 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 5/8] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Aug 24 10:17:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:17:06.877065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:06.878170 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:06.878833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:06.879474 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:06.880360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:06.918743 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:06.923558 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:06.924941 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:06.927088 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:06.927789 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:06.929658 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:07.022706 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Getting quotas for project 66a7713fb6804b4db1fbd15fa71afa74. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:07.033734 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Getting quotas for user 388174c87a2245ca89a634f3b177e166 and project 66a7713fb6804b4db1fbd15fa71afa74. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:07.055155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:07.059443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:07.331334 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4a753c7c-a76c-4e87-a1d5-08d31b86fd47 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.641459 Aug 24 10:17:07.332493 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 4/9] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:17:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 4643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:17:07.354019 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-cecb0d57-b153-4b45-b653-c6e20ea40f3b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:07.358141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-cecb0d57-b153-4b45-b653-c6e20ea40f3b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:07.595885 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-cecb0d57-b153-4b45-b653-c6e20ea40f3b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:07.630752 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-cecb0d57-b153-4b45-b653-c6e20ea40f3b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1222 microversion: 2.1 time: 0.289383 Aug 24 10:17:07.636263 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 6/10] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:07 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1222 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:07.896830 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-206c3cc7-5f43-421a-95f8-bcbee270cbbb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'create', calling method: .version_select at 0x7f0af56f1ee0>, body: {"keypair": {"name": "tempest-keypair-1760383912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrAVWV+1r9KIeETa36onEaY1cSNU2vxIadMRkT/fWBQGYx/J+j0rbwBPhq6W9VVB/BFU2G8+T+GWg3Th9rqusDkh1S39J4b+OA1MtF+1UAoS7uEJ8HLpKrBtwVxq82C1w=="}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:08.007089 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-206c3cc7-5f43-421a-95f8-bcbee270cbbb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Getting quotas for project 297fa582000543acbf078376d7010abb. Resources: {'key_pairs'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:08.033231 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-206c3cc7-5f43-421a-95f8-bcbee270cbbb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Getting quotas for user 71c5ac35123e425e9753f372f9c6bac0 and project 297fa582000543acbf078376d7010abb. Resources: {'key_pairs'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:08.247921 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-206c3cc7-5f43-421a-95f8-bcbee270cbbb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.850066 Aug 24 10:17:08.248982 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 5/11] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Aug 24 10:17:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:08.348905 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2075276316", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:08.539535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.network.neutron [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] validate_networks() for [('cd8e81e0-99a4-4b0d-840b-c6d4a60fe43d', None, None, None, None, None)] {{(pid=121271) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:10.328991 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1681749533", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "networks": [{"uuid": "8842670a-bb7e-4079-bddf-a333e04f1e7c"}]}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:10.445381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] validate_networks() for [('8842670a-bb7e-4079-bddf-a333e04f1e7c', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:10.926736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Flavor limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:10.927439 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Image limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:10.927999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Flavor pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:10.928529 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Image pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:10.931580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:10.952136 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:10.953666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:10.955120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:10.956999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:10.957547 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:10.959146 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:11.035192 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Getting quotas for project 66a7713fb6804b4db1fbd15fa71afa74. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:11.038406 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Getting quotas for user 388174c87a2245ca89a634f3b177e166 and project 66a7713fb6804b4db1fbd15fa71afa74. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:11.063353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Going to run 1 instances... {{(pid=121271) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:11.067521 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:11.281665 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-974e7cce-8bfe-467a-b672-b7b505a1d95d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.935597 Aug 24 10:17:11.285045 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 7/12] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:17:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:17:11.305936 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-005bff9a-1119-48e5-89d4-db442635ecd9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:11.309760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-005bff9a-1119-48e5-89d4-db442635ecd9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:11.518093 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:11.520786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:11.520786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:11.520786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:11.520786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:11.535128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:11.536792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:11.538844 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:11.539818 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:11.542349 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:11.543362 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:11.600019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Getting quotas for project d4b0c27ad44c455eb42d6a21931d42f8. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:11.619974 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Getting quotas for user 669c94a1591f41ae81d27f608987850f and project d4b0c27ad44c455eb42d6a21931d42f8. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:11.671965 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-005bff9a-1119-48e5-89d4-db442635ecd9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:11.688541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:11.694021 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-005bff9a-1119-48e5-89d4-db442635ecd9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1222 microversion: 2.1 time: 0.398274 Aug 24 10:17:11.695205 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 8/13] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:11 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1222 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:11.703353 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:11.948261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a52e4343-7516-42e0-a08c-33c3be4f3b57 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.302587 Aug 24 10:17:11.948933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 6/14] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:17:11.972902 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b6bbba47-e29f-4d0b-a2f6-404ca8de9af5 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:11.974107 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b6bbba47-e29f-4d0b-a2f6-404ca8de9af5 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:12.153338 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b6bbba47-e29f-4d0b-a2f6-404ca8de9af5 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:12.166008 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b6bbba47-e29f-4d0b-a2f6-404ca8de9af5 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1215 microversion: 2.1 time: 0.208886 Aug 24 10:17:12.167039 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 9/15] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:11 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:12.579211 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1224837060", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd93ff68-1984-453a-90ae-b4e36ac7c98e"}], "security_groups": [{"name": "tempest-securitygroup--2134119498"}], "key_name": "tempest-keypair-1333985081", "user_data": "}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:12.729960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-79b527ad-5071-4923-9ca5-6fc8debd8122 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:12.729960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-79b527ad-5071-4923-9ca5-6fc8debd8122 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:12.927584 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-79b527ad-5071-4923-9ca5-6fc8debd8122 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:12.935907 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-79b527ad-5071-4923-9ca5-6fc8debd8122 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1222 microversion: 2.1 time: 0.223315 Aug 24 10:17:12.940734 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] validate_networks() for [('cd93ff68-1984-453a-90ae-b4e36ac7c98e', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:12.941669 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 10/16] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:12 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:13.192454 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bd5d0571-22a6-4bd2-a4d5-ad77bccee0c5 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:13.193116 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bd5d0571-22a6-4bd2-a4d5-ad77bccee0c5 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:13.485931 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-bd5d0571-22a6-4bd2-a4d5-ad77bccee0c5 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:13.502110 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bd5d0571-22a6-4bd2-a4d5-ad77bccee0c5 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1215 microversion: 2.1 time: 0.316479 Aug 24 10:17:13.505511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 11/17] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:13 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1215 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:13.996175 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d2c79eb1-6158-41b5-8366-883e90ad108e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:13.996175 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d2c79eb1-6158-41b5-8366-883e90ad108e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:14.008596 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2c79eb1-6158-41b5-8366-883e90ad108e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:14.013711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2c79eb1-6158-41b5-8366-883e90ad108e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:14.016411 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2c79eb1-6158-41b5-8366-883e90ad108e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:14.017320 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2c79eb1-6158-41b5-8366-883e90ad108e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:14.017898 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2c79eb1-6158-41b5-8366-883e90ad108e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:14.031532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2c79eb1-6158-41b5-8366-883e90ad108e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:14.421318 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d2c79eb1-6158-41b5-8366-883e90ad108e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:14.440249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d2c79eb1-6158-41b5-8366-883e90ad108e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1226 microversion: 2.1 time: 0.484346 Aug 24 10:17:14.454723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 12/18] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:13 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1226 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:14.466114 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1752523753", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77ecb39e-74d7-4180-9556-77b172c2fac8"}], "security_groups": [{"name": "tempest-securitygroup--449824686"}], "key_name": "tempest-keypair-1760383912", "user_data": "}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:14.519684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:14.520169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:14.520652 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:14.521115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:14.521551 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:14.552701 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:14.553689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:14.554291 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:14.555256 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:14.557388 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:14.559158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:14.644899 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for project 8824664cdd104c308141264985a547a1. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:14.657229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for user c94c65ae14e94796a3b3bd0bb29a91b9 and project 8824664cdd104c308141264985a547a1. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:14.685103 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:14.691245 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:14.764728 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.network.neutron [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] validate_networks() for [('77ecb39e-74d7-4180-9556-77b172c2fac8', None, None, None, None, None)] {{(pid=121271) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:17:15.004016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3fb66eef-1168-468a-89fb-5a7bbfb4e950 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.434644 Aug 24 10:17:15.005200 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 7/19] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:17:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:17:15.010291 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-44517f84-76dd-4d65-9604-f711baad808a tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:15.021332 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-44517f84-76dd-4d65-9604-f711baad808a tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:15.044760 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-44517f84-76dd-4d65-9604-f711baad808a tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:15.045612 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-44517f84-76dd-4d65-9604-f711baad808a tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:15.046345 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-44517f84-76dd-4d65-9604-f711baad808a tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:15.047257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-44517f84-76dd-4d65-9604-f711baad808a tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:15.047906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-44517f84-76dd-4d65-9604-f711baad808a tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:15.048525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-44517f84-76dd-4d65-9604-f711baad808a tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:15.540889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-44517f84-76dd-4d65-9604-f711baad808a tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:15.585580 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-44517f84-76dd-4d65-9604-f711baad808a tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1211 microversion: 2.1 time: 0.576654 Aug 24 10:17:15.586296 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 8/20] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:15 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1211 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:15.612116 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b10137c8-8e91-48a8-80e7-f878b9d57d81 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:15.612770 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b10137c8-8e91-48a8-80e7-f878b9d57d81 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:15.615944 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Flavor limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:17:15.616417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Image limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:17:15.616923 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Flavor pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:17:15.617488 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Image pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:17:15.619035 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:17:15.630326 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:15.631224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:15.631372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:15.632300 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:15.632979 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:15.633675 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:15.654245 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Getting quotas for project 297fa582000543acbf078376d7010abb. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:17:15.662311 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Getting quotas for user 71c5ac35123e425e9753f372f9c6bac0 and project 297fa582000543acbf078376d7010abb. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:17:15.688091 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Going to run 1 instances... {{(pid=121271) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:17:15.690526 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:17:16.015902 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b10137c8-8e91-48a8-80e7-f878b9d57d81 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:16.034772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b10137c8-8e91-48a8-80e7-f878b9d57d81 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1242 microversion: 2.1 time: 0.438534 Aug 24 10:17:16.035351 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 9/21] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:15 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1242 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:16.044696 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-91c02216-6256-442b-9e58-11e3510bfa9a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:16.045336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-91c02216-6256-442b-9e58-11e3510bfa9a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:16.059828 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-91c02216-6256-442b-9e58-11e3510bfa9a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:16.060330 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-91c02216-6256-442b-9e58-11e3510bfa9a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:16.060774 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-91c02216-6256-442b-9e58-11e3510bfa9a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:16.061515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-91c02216-6256-442b-9e58-11e3510bfa9a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:16.063899 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-91c02216-6256-442b-9e58-11e3510bfa9a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:16.065535 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-91c02216-6256-442b-9e58-11e3510bfa9a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:16.073140 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c6e1fde6-44b8-4e16-a83b-66b9d39aac44 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.617065 Aug 24 10:17:16.076906 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 13/22] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:17:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:17:16.087788 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f6694264-2313-4e37-985e-713312823435 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:16.088421 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f6694264-2313-4e37-985e-713312823435 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:16.223835 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-91c02216-6256-442b-9e58-11e3510bfa9a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:16.238385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-91c02216-6256-442b-9e58-11e3510bfa9a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1274 microversion: 2.1 time: 0.200750 Aug 24 10:17:16.240497 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 10/23] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:16 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:16.311618 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f6694264-2313-4e37-985e-713312823435 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:16.361819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f6694264-2313-4e37-985e-713312823435 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1238 microversion: 2.1 time: 0.272052 Aug 24 10:17:16.363563 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 14/24] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:16 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1238 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:16.608041 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ce406b81-6836-4085-b9d5-a4795d5d954c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:16.616361 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ce406b81-6836-4085-b9d5-a4795d5d954c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:16.635016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce406b81-6836-4085-b9d5-a4795d5d954c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:16.635520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce406b81-6836-4085-b9d5-a4795d5d954c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:16.635969 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce406b81-6836-4085-b9d5-a4795d5d954c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:16.636679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce406b81-6836-4085-b9d5-a4795d5d954c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:16.646847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce406b81-6836-4085-b9d5-a4795d5d954c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:16.647379 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce406b81-6836-4085-b9d5-a4795d5d954c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.002883 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ce406b81-6836-4085-b9d5-a4795d5d954c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:17.020077 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ce406b81-6836-4085-b9d5-a4795d5d954c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1275 microversion: 2.1 time: 0.415814 Aug 24 10:17:17.023004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 11/25] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:16 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1275 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:17.060318 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-85905bb0-c103-4dd0-83e5-c9912c972d73 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:17.061657 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-85905bb0-c103-4dd0-83e5-c9912c972d73 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:17.244561 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-85905bb0-c103-4dd0-83e5-c9912c972d73 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:17.257413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-85905bb0-c103-4dd0-83e5-c9912c972d73 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1242 microversion: 2.1 time: 0.201322 Aug 24 10:17:17.266800 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-46019692-00a1-446c-b407-3a05f2da30ab tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:17.267429 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-46019692-00a1-446c-b407-3a05f2da30ab tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:17.278374 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 15/26] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:17 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:17.300946 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46019692-00a1-446c-b407-3a05f2da30ab tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.306261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46019692-00a1-446c-b407-3a05f2da30ab tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.308330 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46019692-00a1-446c-b407-3a05f2da30ab tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.310731 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46019692-00a1-446c-b407-3a05f2da30ab tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:17.316909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46019692-00a1-446c-b407-3a05f2da30ab tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:17.316909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46019692-00a1-446c-b407-3a05f2da30ab tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:17.388352 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1c25abe7-b4a9-4e2e-a075-513494aa8084 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:17.389156 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-1c25abe7-b4a9-4e2e-a075-513494aa8084 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:17.644593 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1c25abe7-b4a9-4e2e-a075-513494aa8084 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:17.662840 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1c25abe7-b4a9-4e2e-a075-513494aa8084 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1238 microversion: 2.1 time: 0.278710 Aug 24 10:17:17.666247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 16/27] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:17 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1238 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:17.734114 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-46019692-00a1-446c-b407-3a05f2da30ab tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:17.757246 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-46019692-00a1-446c-b407-3a05f2da30ab tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1280 microversion: 2.1 time: 0.489419 Aug 24 10:17:17.768884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 12/28] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:17 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1280 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:18.084375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2881f36e-9885-43eb-bd5e-9af535f89c9c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:18.091126 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2881f36e-9885-43eb-bd5e-9af535f89c9c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:18.130411 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2881f36e-9885-43eb-bd5e-9af535f89c9c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.138390 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2881f36e-9885-43eb-bd5e-9af535f89c9c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.155993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2881f36e-9885-43eb-bd5e-9af535f89c9c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.155993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2881f36e-9885-43eb-bd5e-9af535f89c9c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.155993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2881f36e-9885-43eb-bd5e-9af535f89c9c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.155993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2881f36e-9885-43eb-bd5e-9af535f89c9c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.284304 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8617c097-acbf-41c0-9738-9fa8d6bc3842 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:18.285312 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8617c097-acbf-41c0-9738-9fa8d6bc3842 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:18.298065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8617c097-acbf-41c0-9738-9fa8d6bc3842 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.299775 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8617c097-acbf-41c0-9738-9fa8d6bc3842 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.300605 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8617c097-acbf-41c0-9738-9fa8d6bc3842 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.301504 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8617c097-acbf-41c0-9738-9fa8d6bc3842 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.302161 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8617c097-acbf-41c0-9738-9fa8d6bc3842 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.302853 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8617c097-acbf-41c0-9738-9fa8d6bc3842 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.376732 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2881f36e-9885-43eb-bd5e-9af535f89c9c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:18.393172 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2881f36e-9885-43eb-bd5e-9af535f89c9c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1273 microversion: 2.1 time: 0.351330 Aug 24 10:17:18.399832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 17/29] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:18 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1273 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:18.698589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9feac966-a1db-43f7-a344-b8e757e51bbf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:18.706817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9feac966-a1db-43f7-a344-b8e757e51bbf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:18.738813 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9feac966-a1db-43f7-a344-b8e757e51bbf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.739320 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9feac966-a1db-43f7-a344-b8e757e51bbf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.739760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9feac966-a1db-43f7-a344-b8e757e51bbf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.740496 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9feac966-a1db-43f7-a344-b8e757e51bbf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.740977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9feac966-a1db-43f7-a344-b8e757e51bbf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.741403 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9feac966-a1db-43f7-a344-b8e757e51bbf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.852034 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9feac966-a1db-43f7-a344-b8e757e51bbf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:18.863440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9feac966-a1db-43f7-a344-b8e757e51bbf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1242 microversion: 2.1 time: 0.177949 Aug 24 10:17:18.872950 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 18/30] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:18 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1242 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:18.873143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8617c097-acbf-41c0-9738-9fa8d6bc3842 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:18.874804 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a31a6e1e-f80a-4940-9d7d-48345e6797b1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:18.877388 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a31a6e1e-f80a-4940-9d7d-48345e6797b1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:18.879836 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8617c097-acbf-41c0-9738-9fa8d6bc3842 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1238 microversion: 2.1 time: 0.599725 Aug 24 10:17:18.885578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 13/31] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:18 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1238 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:18.921356 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a31a6e1e-f80a-4940-9d7d-48345e6797b1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.921953 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a31a6e1e-f80a-4940-9d7d-48345e6797b1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.922490 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a31a6e1e-f80a-4940-9d7d-48345e6797b1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:18.923370 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a31a6e1e-f80a-4940-9d7d-48345e6797b1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:18.924024 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a31a6e1e-f80a-4940-9d7d-48345e6797b1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:18.924528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a31a6e1e-f80a-4940-9d7d-48345e6797b1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.124611 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a31a6e1e-f80a-4940-9d7d-48345e6797b1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:19.386754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a31a6e1e-f80a-4940-9d7d-48345e6797b1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1280 microversion: 2.1 time: 0.261690 Aug 24 10:17:19.386754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 19/32] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:18 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1280 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:19.480381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1f214103-7094-4851-b84e-e373b8bcf7bb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:19.480381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1f214103-7094-4851-b84e-e373b8bcf7bb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:19.480381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f214103-7094-4851-b84e-e373b8bcf7bb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.480381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f214103-7094-4851-b84e-e373b8bcf7bb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.480654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f214103-7094-4851-b84e-e373b8bcf7bb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.480654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f214103-7094-4851-b84e-e373b8bcf7bb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.480654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f214103-7094-4851-b84e-e373b8bcf7bb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.480654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f214103-7094-4851-b84e-e373b8bcf7bb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.504640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1f214103-7094-4851-b84e-e373b8bcf7bb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:19.514530 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1f214103-7094-4851-b84e-e373b8bcf7bb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1273 microversion: 2.1 time: 0.100067 Aug 24 10:17:19.551241 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 14/33] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:19 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:19.886748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7434e8af-4195-4c5c-b98f-8fe530c9100c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:19.887721 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7434e8af-4195-4c5c-b98f-8fe530c9100c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:19.894656 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7434e8af-4195-4c5c-b98f-8fe530c9100c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.895531 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7434e8af-4195-4c5c-b98f-8fe530c9100c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.896176 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7434e8af-4195-4c5c-b98f-8fe530c9100c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.897345 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7434e8af-4195-4c5c-b98f-8fe530c9100c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.898001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7434e8af-4195-4c5c-b98f-8fe530c9100c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.898605 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7434e8af-4195-4c5c-b98f-8fe530c9100c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.908349 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1afad16c-9da7-4484-9577-2793637951d5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:19.914588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1afad16c-9da7-4484-9577-2793637951d5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:19.918069 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1afad16c-9da7-4484-9577-2793637951d5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.918654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1afad16c-9da7-4484-9577-2793637951d5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.919161 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1afad16c-9da7-4484-9577-2793637951d5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:19.919936 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1afad16c-9da7-4484-9577-2793637951d5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:19.920505 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1afad16c-9da7-4484-9577-2793637951d5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:19.921080 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1afad16c-9da7-4484-9577-2793637951d5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.031760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7434e8af-4195-4c5c-b98f-8fe530c9100c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:20.045855 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7434e8af-4195-4c5c-b98f-8fe530c9100c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1290 microversion: 2.1 time: 0.162213 Aug 24 10:17:20.058777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 20/34] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:19 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1290 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:20.095156 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1afad16c-9da7-4484-9577-2793637951d5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:20.102918 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1afad16c-9da7-4484-9577-2793637951d5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1294 microversion: 2.1 time: 0.199071 Aug 24 10:17:20.103640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 15/35] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:19 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1294 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:20.400381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e7a16a58-8834-4ce8-b754-a22f4497526d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:20.401044 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e7a16a58-8834-4ce8-b754-a22f4497526d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:20.415102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7a16a58-8834-4ce8-b754-a22f4497526d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.416343 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7a16a58-8834-4ce8-b754-a22f4497526d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.417320 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7a16a58-8834-4ce8-b754-a22f4497526d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.422888 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7a16a58-8834-4ce8-b754-a22f4497526d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.423660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7a16a58-8834-4ce8-b754-a22f4497526d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.424469 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7a16a58-8834-4ce8-b754-a22f4497526d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.513485 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e7a16a58-8834-4ce8-b754-a22f4497526d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:20.521111 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e7a16a58-8834-4ce8-b754-a22f4497526d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1280 microversion: 2.1 time: 0.124955 Aug 24 10:17:20.521679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 21/36] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:20 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:20.564313 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-610649fd-f3ae-46ec-bd5c-633f344876af tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:20.577820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-610649fd-f3ae-46ec-bd5c-633f344876af tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:20.577820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-610649fd-f3ae-46ec-bd5c-633f344876af tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.577820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-610649fd-f3ae-46ec-bd5c-633f344876af tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.577820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-610649fd-f3ae-46ec-bd5c-633f344876af tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.579088 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-610649fd-f3ae-46ec-bd5c-633f344876af tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:20.579088 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-610649fd-f3ae-46ec-bd5c-633f344876af tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:20.579088 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-610649fd-f3ae-46ec-bd5c-633f344876af tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:20.890662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-610649fd-f3ae-46ec-bd5c-633f344876af tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:20.898654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-610649fd-f3ae-46ec-bd5c-633f344876af tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.338458 Aug 24 10:17:20.900605 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 16/37] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:20 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:21.073855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-88f71889-c7e8-4446-972a-1cc316625d66 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:21.073855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-88f71889-c7e8-4446-972a-1cc316625d66 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:21.081903 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-9d772157-b927-4ed3-8d3a-c2d2c2812bf5 req-66d813f0-0849-40bc-b2d2-c44ac3eb337b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634", "tag": "f28dce31-d9c2-4fa3-a64a-63c9f2a85bd8"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:21.084012 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88f71889-c7e8-4446-972a-1cc316625d66 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.085730 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88f71889-c7e8-4446-972a-1cc316625d66 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.086194 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88f71889-c7e8-4446-972a-1cc316625d66 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.089260 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88f71889-c7e8-4446-972a-1cc316625d66 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.089853 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88f71889-c7e8-4446-972a-1cc316625d66 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.090363 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88f71889-c7e8-4446-972a-1cc316625d66 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.117572 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-9d772157-b927-4ed3-8d3a-c2d2c2812bf5 req-66d813f0-0849-40bc-b2d2-c44ac3eb337b service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.120426 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-9d772157-b927-4ed3-8d3a-c2d2c2812bf5 req-66d813f0-0849-40bc-b2d2-c44ac3eb337b service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.121124 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-9d772157-b927-4ed3-8d3a-c2d2c2812bf5 req-66d813f0-0849-40bc-b2d2-c44ac3eb337b service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.164205 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-9d772157-b927-4ed3-8d3a-c2d2c2812bf5 req-66d813f0-0849-40bc-b2d2-c44ac3eb337b service nova] Creating event network-changed:f28dce31-d9c2-4fa3-a64a-63c9f2a85bd8 for instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 on hv-cinder-85427 Aug 24 10:17:21.171354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-9d772157-b927-4ed3-8d3a-c2d2c2812bf5 req-66d813f0-0849-40bc-b2d2-c44ac3eb337b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121271) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:17:21.172015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-9d772157-b927-4ed3-8d3a-c2d2c2812bf5 req-66d813f0-0849-40bc-b2d2-c44ac3eb337b service nova] Acquired lock "compute-rpcapi-router" {{(pid=121271) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:17:21.187805 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d874282f-4809-4e2a-b370-b36bb76e95ae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.189456 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d874282f-4809-4e2a-b370-b36bb76e95ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.190117 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d874282f-4809-4e2a-b370-b36bb76e95ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.195314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d874282f-4809-4e2a-b370-b36bb76e95ae None None] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.197374 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d874282f-4809-4e2a-b370-b36bb76e95ae None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.197374 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d874282f-4809-4e2a-b370-b36bb76e95ae None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.229461 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-88f71889-c7e8-4446-972a-1cc316625d66 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:21.237673 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.compute.rpcapi [None req-d874282f-4809-4e2a-b370-b36bb76e95ae None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 10:17:21.238712 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-88f71889-c7e8-4446-972a-1cc316625d66 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1290 microversion: 2.1 time: 0.173845 Aug 24 10:17:21.240150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d874282f-4809-4e2a-b370-b36bb76e95ae None None] Releasing lock "compute-rpcapi-router" {{(pid=121271) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:17:21.255808 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 17/38] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:21 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1290 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:21.261886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-382a249a-1f1d-446a-a46a-8a924182906a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:21.265141 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-382a249a-1f1d-446a-a46a-8a924182906a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:21.274778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-382a249a-1f1d-446a-a46a-8a924182906a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.276625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-382a249a-1f1d-446a-a46a-8a924182906a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.276625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-382a249a-1f1d-446a-a46a-8a924182906a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.276980 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-382a249a-1f1d-446a-a46a-8a924182906a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.277496 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-382a249a-1f1d-446a-a46a-8a924182906a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.277977 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-382a249a-1f1d-446a-a46a-8a924182906a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.286352 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d874282f-4809-4e2a-b370-b36bb76e95ae None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300686 Aug 24 10:17:21.287081 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 22/39] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:21.355960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-382a249a-1f1d-446a-a46a-8a924182906a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:21.368536 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-382a249a-1f1d-446a-a46a-8a924182906a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1294 microversion: 2.1 time: 0.110759 Aug 24 10:17:21.369776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 18/40] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:21 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:21.547228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ef8b427b-dcc6-49a4-8317-5ffe94808dbc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:21.548933 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ef8b427b-dcc6-49a4-8317-5ffe94808dbc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:21.559728 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ef8b427b-dcc6-49a4-8317-5ffe94808dbc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.560531 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ef8b427b-dcc6-49a4-8317-5ffe94808dbc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.561196 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ef8b427b-dcc6-49a4-8317-5ffe94808dbc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.582711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ef8b427b-dcc6-49a4-8317-5ffe94808dbc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.583257 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ef8b427b-dcc6-49a4-8317-5ffe94808dbc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.583861 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ef8b427b-dcc6-49a4-8317-5ffe94808dbc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.771997 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-ef8b427b-dcc6-49a4-8317-5ffe94808dbc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:21.791583 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ef8b427b-dcc6-49a4-8317-5ffe94808dbc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.251520 Aug 24 10:17:21.805246 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 23/41] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:21 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:21.920600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1a1599a7-2942-4f5f-afc2-2fa2a0d11e95 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:21.921700 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1a1599a7-2942-4f5f-afc2-2fa2a0d11e95 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:21.928173 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a1599a7-2942-4f5f-afc2-2fa2a0d11e95 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.928843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a1599a7-2942-4f5f-afc2-2fa2a0d11e95 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.929474 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a1599a7-2942-4f5f-afc2-2fa2a0d11e95 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:21.930338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a1599a7-2942-4f5f-afc2-2fa2a0d11e95 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:21.931009 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a1599a7-2942-4f5f-afc2-2fa2a0d11e95 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:21.931769 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a1599a7-2942-4f5f-afc2-2fa2a0d11e95 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.133475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1a1599a7-2942-4f5f-afc2-2fa2a0d11e95 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:22.142000 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1a1599a7-2942-4f5f-afc2-2fa2a0d11e95 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.225604 Aug 24 10:17:22.148029 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 19/42] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:21 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:22.271612 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b7864a84-5882-42f4-8904-10d3fd2cb45e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:22.272528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b7864a84-5882-42f4-8904-10d3fd2cb45e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:22.287862 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b7864a84-5882-42f4-8904-10d3fd2cb45e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.296723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b7864a84-5882-42f4-8904-10d3fd2cb45e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.296723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b7864a84-5882-42f4-8904-10d3fd2cb45e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.296723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b7864a84-5882-42f4-8904-10d3fd2cb45e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.296723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b7864a84-5882-42f4-8904-10d3fd2cb45e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.297155 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b7864a84-5882-42f4-8904-10d3fd2cb45e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.381840 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b7864a84-5882-42f4-8904-10d3fd2cb45e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:22.391866 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-518b86ad-417c-406f-9ebc-1721851c3e39 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:22.392734 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-518b86ad-417c-406f-9ebc-1721851c3e39 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:22.400272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b7864a84-5882-42f4-8904-10d3fd2cb45e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1290 microversion: 2.1 time: 0.134971 Aug 24 10:17:22.401919 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-518b86ad-417c-406f-9ebc-1721851c3e39 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.402830 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-518b86ad-417c-406f-9ebc-1721851c3e39 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.403438 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-518b86ad-417c-406f-9ebc-1721851c3e39 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.404494 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-518b86ad-417c-406f-9ebc-1721851c3e39 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.405245 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-518b86ad-417c-406f-9ebc-1721851c3e39 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.410315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-518b86ad-417c-406f-9ebc-1721851c3e39 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.413945 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 24/43] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:22 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1290 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:22.546422 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-518b86ad-417c-406f-9ebc-1721851c3e39 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:22.554595 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-518b86ad-417c-406f-9ebc-1721851c3e39 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1302 microversion: 2.1 time: 0.166848 Aug 24 10:17:22.570510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 20/44] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:22 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1302 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:22.814437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8ef562c2-f995-4eea-b9fc-1ad4254a17c2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:22.815167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8ef562c2-f995-4eea-b9fc-1ad4254a17c2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:22.822320 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ef562c2-f995-4eea-b9fc-1ad4254a17c2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.822840 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ef562c2-f995-4eea-b9fc-1ad4254a17c2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.823274 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ef562c2-f995-4eea-b9fc-1ad4254a17c2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:22.823973 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ef562c2-f995-4eea-b9fc-1ad4254a17c2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:22.824422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ef562c2-f995-4eea-b9fc-1ad4254a17c2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:22.824846 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ef562c2-f995-4eea-b9fc-1ad4254a17c2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.066192 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8ef562c2-f995-4eea-b9fc-1ad4254a17c2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:23.077188 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8ef562c2-f995-4eea-b9fc-1ad4254a17c2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.266630 Aug 24 10:17:23.092851 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 25/45] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:22 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:23.171220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ac61c9b0-11e2-40aa-adaf-455f3f89852f tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:23.171220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ac61c9b0-11e2-40aa-adaf-455f3f89852f tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:23.178496 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ac61c9b0-11e2-40aa-adaf-455f3f89852f tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.179225 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ac61c9b0-11e2-40aa-adaf-455f3f89852f tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.180058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ac61c9b0-11e2-40aa-adaf-455f3f89852f tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.181790 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ac61c9b0-11e2-40aa-adaf-455f3f89852f tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.182563 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ac61c9b0-11e2-40aa-adaf-455f3f89852f tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.183125 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ac61c9b0-11e2-40aa-adaf-455f3f89852f tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.378506 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ac61c9b0-11e2-40aa-adaf-455f3f89852f tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:23.388693 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ac61c9b0-11e2-40aa-adaf-455f3f89852f tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.224927 Aug 24 10:17:23.396417 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 21/46] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:23 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:23.425588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-5a972e1a-f159-4f8a-aea9-a2536eedb08a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:23.425588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-5a972e1a-f159-4f8a-aea9-a2536eedb08a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:23.431877 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:23.433537 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a972e1a-f159-4f8a-aea9-a2536eedb08a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.434094 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a972e1a-f159-4f8a-aea9-a2536eedb08a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.434536 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a972e1a-f159-4f8a-aea9-a2536eedb08a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.435313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a972e1a-f159-4f8a-aea9-a2536eedb08a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.435774 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a972e1a-f159-4f8a-aea9-a2536eedb08a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.436203 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a972e1a-f159-4f8a-aea9-a2536eedb08a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.534141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-5a972e1a-f159-4f8a-aea9-a2536eedb08a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:23.550181 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-5a972e1a-f159-4f8a-aea9-a2536eedb08a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1290 microversion: 2.1 time: 0.131351 Aug 24 10:17:23.564102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 26/47] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:23 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1290 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:23.580799 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7863e5ea-e4fa-4509-9460-8d30c8f3ec04 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:23.580799 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7863e5ea-e4fa-4509-9460-8d30c8f3ec04 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:23.598639 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7863e5ea-e4fa-4509-9460-8d30c8f3ec04 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.603787 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7863e5ea-e4fa-4509-9460-8d30c8f3ec04 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.603787 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7863e5ea-e4fa-4509-9460-8d30c8f3ec04 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.603787 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7863e5ea-e4fa-4509-9460-8d30c8f3ec04 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:23.603787 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7863e5ea-e4fa-4509-9460-8d30c8f3ec04 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:23.604347 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7863e5ea-e4fa-4509-9460-8d30c8f3ec04 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:23.897129 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7863e5ea-e4fa-4509-9460-8d30c8f3ec04 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:23.908353 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7863e5ea-e4fa-4509-9460-8d30c8f3ec04 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1302 microversion: 2.1 time: 0.336205 Aug 24 10:17:23.932694 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 22/48] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:23 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1302 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:24.099754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ce3236af-3182-4c3b-82fb-955f3dc71c3e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:24.100993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ce3236af-3182-4c3b-82fb-955f3dc71c3e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:24.111672 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ce3236af-3182-4c3b-82fb-955f3dc71c3e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.112259 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ce3236af-3182-4c3b-82fb-955f3dc71c3e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.113358 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ce3236af-3182-4c3b-82fb-955f3dc71c3e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.114111 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ce3236af-3182-4c3b-82fb-955f3dc71c3e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.114589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ce3236af-3182-4c3b-82fb-955f3dc71c3e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.115036 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ce3236af-3182-4c3b-82fb-955f3dc71c3e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.312011 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-ce3236af-3182-4c3b-82fb-955f3dc71c3e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:24.322515 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ce3236af-3182-4c3b-82fb-955f3dc71c3e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.226853 Aug 24 10:17:24.325628 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 27/49] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:24 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:24.411803 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-766f862c-f24b-4c6b-8a71-efe1bc23439d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:24.412405 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-766f862c-f24b-4c6b-8a71-efe1bc23439d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:24.419085 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-766f862c-f24b-4c6b-8a71-efe1bc23439d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.419974 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-766f862c-f24b-4c6b-8a71-efe1bc23439d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.420584 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-766f862c-f24b-4c6b-8a71-efe1bc23439d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.421535 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-766f862c-f24b-4c6b-8a71-efe1bc23439d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.422189 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-766f862c-f24b-4c6b-8a71-efe1bc23439d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.422752 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-766f862c-f24b-4c6b-8a71-efe1bc23439d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.584628 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1515e374-6a8a-4e46-a57a-499255f1ef46 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:24.585310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-1515e374-6a8a-4e46-a57a-499255f1ef46 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:24.595677 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1515e374-6a8a-4e46-a57a-499255f1ef46 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.596206 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1515e374-6a8a-4e46-a57a-499255f1ef46 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.596638 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1515e374-6a8a-4e46-a57a-499255f1ef46 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.604273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1515e374-6a8a-4e46-a57a-499255f1ef46 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.611163 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1515e374-6a8a-4e46-a57a-499255f1ef46 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.611859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1515e374-6a8a-4e46-a57a-499255f1ef46 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.615177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=6 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:24.653022 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-766f862c-f24b-4c6b-8a71-efe1bc23439d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:24.663092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-766f862c-f24b-4c6b-8a71-efe1bc23439d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.255528 Aug 24 10:17:24.665971 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 23/50] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:24 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:24.756427 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1515e374-6a8a-4e46-a57a-499255f1ef46 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:24.766877 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1515e374-6a8a-4e46-a57a-499255f1ef46 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1290 microversion: 2.1 time: 0.198430 Aug 24 10:17:24.770777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 28/51] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:24 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1290 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:24.934777 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9ca4ff45-1141-4ce9-8b62-cb8f32607f88 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:24.934921 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9ca4ff45-1141-4ce9-8b62-cb8f32607f88 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:24.942618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9ca4ff45-1141-4ce9-8b62-cb8f32607f88 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.943350 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9ca4ff45-1141-4ce9-8b62-cb8f32607f88 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.944001 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9ca4ff45-1141-4ce9-8b62-cb8f32607f88 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.944849 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9ca4ff45-1141-4ce9-8b62-cb8f32607f88 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:24.945530 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9ca4ff45-1141-4ce9-8b62-cb8f32607f88 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:24.946660 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9ca4ff45-1141-4ce9-8b62-cb8f32607f88 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:24.967074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:25.015599 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9ca4ff45-1141-4ce9-8b62-cb8f32607f88 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:25.023890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9ca4ff45-1141-4ce9-8b62-cb8f32607f88 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1302 microversion: 2.1 time: 0.093919 Aug 24 10:17:25.024521 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 24/52] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:24 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:25.348211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-20bb5cee-d823-432a-b501-8430ea44c792 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:25.348896 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-20bb5cee-d823-432a-b501-8430ea44c792 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:25.356319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20bb5cee-d823-432a-b501-8430ea44c792 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.357055 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20bb5cee-d823-432a-b501-8430ea44c792 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.357666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20bb5cee-d823-432a-b501-8430ea44c792 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.358564 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20bb5cee-d823-432a-b501-8430ea44c792 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.359307 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20bb5cee-d823-432a-b501-8430ea44c792 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.360118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20bb5cee-d823-432a-b501-8430ea44c792 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.524789 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-20bb5cee-d823-432a-b501-8430ea44c792 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:25.532432 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-20bb5cee-d823-432a-b501-8430ea44c792 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.188507 Aug 24 10:17:25.533038 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 29/53] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:25 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:25.691964 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b7cce633-6883-4057-be87-b1c6c50eb03c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:25.693724 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b7cce633-6883-4057-be87-b1c6c50eb03c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:25.698833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:25.707572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7cce633-6883-4057-be87-b1c6c50eb03c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.708156 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7cce633-6883-4057-be87-b1c6c50eb03c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.708660 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7cce633-6883-4057-be87-b1c6c50eb03c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.709644 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7cce633-6883-4057-be87-b1c6c50eb03c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.710165 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7cce633-6883-4057-be87-b1c6c50eb03c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.710809 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7cce633-6883-4057-be87-b1c6c50eb03c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.794707 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8b240a90-0047-49c7-8f46-37a382d33ff2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:25.795375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8b240a90-0047-49c7-8f46-37a382d33ff2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:25.804806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b240a90-0047-49c7-8f46-37a382d33ff2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.809646 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b240a90-0047-49c7-8f46-37a382d33ff2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.811352 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b240a90-0047-49c7-8f46-37a382d33ff2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.814916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b240a90-0047-49c7-8f46-37a382d33ff2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:25.815683 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b240a90-0047-49c7-8f46-37a382d33ff2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:25.816311 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b240a90-0047-49c7-8f46-37a382d33ff2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:25.910622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8b240a90-0047-49c7-8f46-37a382d33ff2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:25.920829 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8b240a90-0047-49c7-8f46-37a382d33ff2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1290 microversion: 2.1 time: 0.133070 Aug 24 10:17:25.921975 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 30/54] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:25 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1290 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:25.954429 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b7cce633-6883-4057-be87-b1c6c50eb03c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:25.964758 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b7cce633-6883-4057-be87-b1c6c50eb03c tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.277786 Aug 24 10:17:25.976765 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 25/55] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:25 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:26.045694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-71fdb822-49e2-41d1-a09d-877285e66596 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:26.049050 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-71fdb822-49e2-41d1-a09d-877285e66596 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:26.053207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71fdb822-49e2-41d1-a09d-877285e66596 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.054111 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71fdb822-49e2-41d1-a09d-877285e66596 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.054836 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71fdb822-49e2-41d1-a09d-877285e66596 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.056049 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71fdb822-49e2-41d1-a09d-877285e66596 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.056635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71fdb822-49e2-41d1-a09d-877285e66596 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.057295 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71fdb822-49e2-41d1-a09d-877285e66596 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.126537 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-71fdb822-49e2-41d1-a09d-877285e66596 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:26.136299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-71fdb822-49e2-41d1-a09d-877285e66596 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1302 microversion: 2.1 time: 0.094411 Aug 24 10:17:26.137552 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 31/56] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:26 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:26.557194 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-eb6b343f-549d-49cc-bef6-34674fe9efba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:26.557642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-eb6b343f-549d-49cc-bef6-34674fe9efba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:26.560471 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=24 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:26.563903 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb6b343f-549d-49cc-bef6-34674fe9efba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.564408 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb6b343f-549d-49cc-bef6-34674fe9efba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.565152 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb6b343f-549d-49cc-bef6-34674fe9efba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.566225 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb6b343f-549d-49cc-bef6-34674fe9efba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.566683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb6b343f-549d-49cc-bef6-34674fe9efba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.567486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb6b343f-549d-49cc-bef6-34674fe9efba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.734885 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-eb6b343f-549d-49cc-bef6-34674fe9efba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:26.760488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-eb6b343f-549d-49cc-bef6-34674fe9efba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.196275 Aug 24 10:17:26.760488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 26/57] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:26 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:26.943099 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9669a600-f0d4-4e11-9e9d-591e9d5f41e3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:26.944301 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9669a600-f0d4-4e11-9e9d-591e9d5f41e3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:26.951538 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9669a600-f0d4-4e11-9e9d-591e9d5f41e3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.952016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9669a600-f0d4-4e11-9e9d-591e9d5f41e3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.952721 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9669a600-f0d4-4e11-9e9d-591e9d5f41e3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.953374 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9669a600-f0d4-4e11-9e9d-591e9d5f41e3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:26.954027 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9669a600-f0d4-4e11-9e9d-591e9d5f41e3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:26.954644 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9669a600-f0d4-4e11-9e9d-591e9d5f41e3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:26.980091 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=100 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:26.987711 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-814baf35-08f9-4ab8-a912-38faaeb4f51e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:26.988418 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-814baf35-08f9-4ab8-a912-38faaeb4f51e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:27.004783 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-814baf35-08f9-4ab8-a912-38faaeb4f51e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.005352 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-814baf35-08f9-4ab8-a912-38faaeb4f51e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.005777 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-814baf35-08f9-4ab8-a912-38faaeb4f51e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.006483 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-814baf35-08f9-4ab8-a912-38faaeb4f51e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.006937 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-814baf35-08f9-4ab8-a912-38faaeb4f51e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.007360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-814baf35-08f9-4ab8-a912-38faaeb4f51e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.041198 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9669a600-f0d4-4e11-9e9d-591e9d5f41e3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:27.059079 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9669a600-f0d4-4e11-9e9d-591e9d5f41e3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1290 microversion: 2.1 time: 0.120712 Aug 24 10:17:27.062185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 32/58] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:26 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:27.157600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-96338037-e17d-4304-955e-45f2fa911568 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:27.158736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-96338037-e17d-4304-955e-45f2fa911568 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:27.169416 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96338037-e17d-4304-955e-45f2fa911568 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.170059 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96338037-e17d-4304-955e-45f2fa911568 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.170411 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96338037-e17d-4304-955e-45f2fa911568 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.175310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96338037-e17d-4304-955e-45f2fa911568 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.175310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96338037-e17d-4304-955e-45f2fa911568 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.175310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96338037-e17d-4304-955e-45f2fa911568 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.203717 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-814baf35-08f9-4ab8-a912-38faaeb4f51e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:27.218391 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-814baf35-08f9-4ab8-a912-38faaeb4f51e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.234241 Aug 24 10:17:27.219305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 27/59] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:26 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:27.263190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-96338037-e17d-4304-955e-45f2fa911568 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:27.273029 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-96338037-e17d-4304-955e-45f2fa911568 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1302 microversion: 2.1 time: 0.119200 Aug 24 10:17:27.279600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 33/60] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:27 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:27.772547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1c291212-e3a0-41f8-9aa6-9b4c0d07fb6a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:27.773848 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1c291212-e3a0-41f8-9aa6-9b4c0d07fb6a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:27.781926 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1c291212-e3a0-41f8-9aa6-9b4c0d07fb6a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.782201 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1c291212-e3a0-41f8-9aa6-9b4c0d07fb6a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.782523 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1c291212-e3a0-41f8-9aa6-9b4c0d07fb6a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.783375 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1c291212-e3a0-41f8-9aa6-9b4c0d07fb6a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:27.784644 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1c291212-e3a0-41f8-9aa6-9b4c0d07fb6a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:27.785098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1c291212-e3a0-41f8-9aa6-9b4c0d07fb6a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:27.938515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1c291212-e3a0-41f8-9aa6-9b4c0d07fb6a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:27.947806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1c291212-e3a0-41f8-9aa6-9b4c0d07fb6a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.178832 Aug 24 10:17:27.948393 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 28/61] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:27 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:28.081234 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-89fc0116-5402-462b-ac9d-894249588d1c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:28.081980 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-89fc0116-5402-462b-ac9d-894249588d1c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:28.084058 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=32 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:28.089362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-89fc0116-5402-462b-ac9d-894249588d1c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.089848 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-89fc0116-5402-462b-ac9d-894249588d1c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.090421 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-89fc0116-5402-462b-ac9d-894249588d1c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.091144 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-89fc0116-5402-462b-ac9d-894249588d1c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.091752 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-89fc0116-5402-462b-ac9d-894249588d1c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.092327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-89fc0116-5402-462b-ac9d-894249588d1c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.160454 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-89fc0116-5402-462b-ac9d-894249588d1c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:28.168483 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-89fc0116-5402-462b-ac9d-894249588d1c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1290 microversion: 2.1 time: 0.091901 Aug 24 10:17:28.169176 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 34/62] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:28 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:28.241883 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-dde065d1-c7d2-40ce-8f8f-0c303f175a5b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:28.242692 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-dde065d1-c7d2-40ce-8f8f-0c303f175a5b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:28.251516 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dde065d1-c7d2-40ce-8f8f-0c303f175a5b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.252031 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dde065d1-c7d2-40ce-8f8f-0c303f175a5b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.252469 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dde065d1-c7d2-40ce-8f8f-0c303f175a5b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.253252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dde065d1-c7d2-40ce-8f8f-0c303f175a5b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.253706 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dde065d1-c7d2-40ce-8f8f-0c303f175a5b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.254181 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dde065d1-c7d2-40ce-8f8f-0c303f175a5b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.317710 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-763d0dd8-04ad-48ce-a41d-a948aaf8be97 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:28.318379 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-763d0dd8-04ad-48ce-a41d-a948aaf8be97 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:28.328213 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-763d0dd8-04ad-48ce-a41d-a948aaf8be97 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.331852 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-763d0dd8-04ad-48ce-a41d-a948aaf8be97 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.332547 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-763d0dd8-04ad-48ce-a41d-a948aaf8be97 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.334503 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-763d0dd8-04ad-48ce-a41d-a948aaf8be97 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.335015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-763d0dd8-04ad-48ce-a41d-a948aaf8be97 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.335388 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-763d0dd8-04ad-48ce-a41d-a948aaf8be97 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.441822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-763d0dd8-04ad-48ce-a41d-a948aaf8be97 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:28.450787 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-763d0dd8-04ad-48ce-a41d-a948aaf8be97 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1302 microversion: 2.1 time: 0.160068 Aug 24 10:17:28.452163 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 35/63] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:28 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1302 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:28.475496 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-dde065d1-c7d2-40ce-8f8f-0c303f175a5b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:28.485285 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-dde065d1-c7d2-40ce-8f8f-0c303f175a5b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.247622 Aug 24 10:17:28.485880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 29/64] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:28 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:28.969800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-09b658e3-0c9a-410d-ac8c-702af555c231 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:28.970416 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-09b658e3-0c9a-410d-ac8c-702af555c231 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:28.976834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-09b658e3-0c9a-410d-ac8c-702af555c231 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.978156 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-09b658e3-0c9a-410d-ac8c-702af555c231 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.978566 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-09b658e3-0c9a-410d-ac8c-702af555c231 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:28.979403 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-09b658e3-0c9a-410d-ac8c-702af555c231 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:28.979844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-09b658e3-0c9a-410d-ac8c-702af555c231 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:28.980270 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-09b658e3-0c9a-410d-ac8c-702af555c231 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:29.125118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-09b658e3-0c9a-410d-ac8c-702af555c231 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:29.153015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-09b658e3-0c9a-410d-ac8c-702af555c231 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.187066 Aug 24 10:17:29.153602 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 36/65] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:28 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:29.190944 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e6683bf5-cc0c-429f-810f-fc33fa2d3357 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:29.191884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-e6683bf5-cc0c-429f-810f-fc33fa2d3357 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:29.199800 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6683bf5-cc0c-429f-810f-fc33fa2d3357 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:29.200746 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6683bf5-cc0c-429f-810f-fc33fa2d3357 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:29.201566 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6683bf5-cc0c-429f-810f-fc33fa2d3357 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:29.202745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6683bf5-cc0c-429f-810f-fc33fa2d3357 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:29.203554 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6683bf5-cc0c-429f-810f-fc33fa2d3357 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:29.204338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6683bf5-cc0c-429f-810f-fc33fa2d3357 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:29.298461 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e6683bf5-cc0c-429f-810f-fc33fa2d3357 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:29.307649 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e6683bf5-cc0c-429f-810f-fc33fa2d3357 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1290 microversion: 2.1 time: 0.120731 Aug 24 10:17:29.308253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 30/66] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:29 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:29.473614 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-76e73cad-97b4-44e5-9bf6-88487698427e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:29.474337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-76e73cad-97b4-44e5-9bf6-88487698427e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:29.481447 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76e73cad-97b4-44e5-9bf6-88487698427e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:29.481978 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76e73cad-97b4-44e5-9bf6-88487698427e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:29.482443 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76e73cad-97b4-44e5-9bf6-88487698427e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:29.483220 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76e73cad-97b4-44e5-9bf6-88487698427e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:29.483705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76e73cad-97b4-44e5-9bf6-88487698427e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:29.484163 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76e73cad-97b4-44e5-9bf6-88487698427e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:29.514218 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8e80a1bb-f3e7-4457-a528-3e5703481e62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:29.514218 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8e80a1bb-f3e7-4457-a528-3e5703481e62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:29.515881 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8e80a1bb-f3e7-4457-a528-3e5703481e62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:29.516599 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8e80a1bb-f3e7-4457-a528-3e5703481e62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:29.517128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8e80a1bb-f3e7-4457-a528-3e5703481e62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:29.517897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8e80a1bb-f3e7-4457-a528-3e5703481e62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:29.518443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8e80a1bb-f3e7-4457-a528-3e5703481e62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:29.518964 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8e80a1bb-f3e7-4457-a528-3e5703481e62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:29.549700 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-76e73cad-97b4-44e5-9bf6-88487698427e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:29.557928 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-76e73cad-97b4-44e5-9bf6-88487698427e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1302 microversion: 2.1 time: 0.088751 Aug 24 10:17:29.558512 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 37/67] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:29 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:29.675396 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8e80a1bb-f3e7-4457-a528-3e5703481e62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:29.683827 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8e80a1bb-f3e7-4457-a528-3e5703481e62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.179805 Aug 24 10:17:29.684546 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 31/68] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:29 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:30.174446 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-794030c0-8379-4750-a17b-5de32f44a6ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:30.175617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-794030c0-8379-4750-a17b-5de32f44a6ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:30.182399 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-794030c0-8379-4750-a17b-5de32f44a6ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.183083 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-794030c0-8379-4750-a17b-5de32f44a6ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.183674 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-794030c0-8379-4750-a17b-5de32f44a6ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.185013 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-794030c0-8379-4750-a17b-5de32f44a6ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.185621 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-794030c0-8379-4750-a17b-5de32f44a6ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.186168 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-794030c0-8379-4750-a17b-5de32f44a6ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.328827 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b2f04667-ae57-4f98-9836-f39a8d742be5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:30.329455 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b2f04667-ae57-4f98-9836-f39a8d742be5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:30.336057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2f04667-ae57-4f98-9836-f39a8d742be5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.336886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2f04667-ae57-4f98-9836-f39a8d742be5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.337360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2f04667-ae57-4f98-9836-f39a8d742be5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.342388 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2f04667-ae57-4f98-9836-f39a8d742be5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.342388 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2f04667-ae57-4f98-9836-f39a8d742be5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.342388 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2f04667-ae57-4f98-9836-f39a8d742be5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.469774 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b2f04667-ae57-4f98-9836-f39a8d742be5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:30.478547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b2f04667-ae57-4f98-9836-f39a8d742be5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1290 microversion: 2.1 time: 0.154190 Aug 24 10:17:30.479650 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 32/69] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:30 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1290 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:30.578759 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7a5d3f3c-d23f-405f-9c63-548ae016ad16 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:30.579385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7a5d3f3c-d23f-405f-9c63-548ae016ad16 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:30.588297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a5d3f3c-d23f-405f-9c63-548ae016ad16 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.588790 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a5d3f3c-d23f-405f-9c63-548ae016ad16 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.589257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a5d3f3c-d23f-405f-9c63-548ae016ad16 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.589960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a5d3f3c-d23f-405f-9c63-548ae016ad16 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.590416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a5d3f3c-d23f-405f-9c63-548ae016ad16 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.590840 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a5d3f3c-d23f-405f-9c63-548ae016ad16 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.619890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-794030c0-8379-4750-a17b-5de32f44a6ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:30.630206 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-794030c0-8379-4750-a17b-5de32f44a6ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.459805 Aug 24 10:17:30.631344 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 38/70] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:30 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:30.691746 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7a5d3f3c-d23f-405f-9c63-548ae016ad16 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:30.708152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b11ee1e5-71aa-47ad-b56d-0d83ef3983cb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:30.708907 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b11ee1e5-71aa-47ad-b56d-0d83ef3983cb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:30.716973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7a5d3f3c-d23f-405f-9c63-548ae016ad16 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1312 microversion: 2.1 time: 0.141198 Aug 24 10:17:30.718186 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 33/71] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:30 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1312 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:30.721901 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b11ee1e5-71aa-47ad-b56d-0d83ef3983cb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.733449 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b11ee1e5-71aa-47ad-b56d-0d83ef3983cb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.734145 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b11ee1e5-71aa-47ad-b56d-0d83ef3983cb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:30.735107 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b11ee1e5-71aa-47ad-b56d-0d83ef3983cb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:30.735759 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b11ee1e5-71aa-47ad-b56d-0d83ef3983cb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:30.736401 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b11ee1e5-71aa-47ad-b56d-0d83ef3983cb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:31.228735 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=6 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:31.257894 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b11ee1e5-71aa-47ad-b56d-0d83ef3983cb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:31.265952 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b11ee1e5-71aa-47ad-b56d-0d83ef3983cb tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.563998 Aug 24 10:17:31.267367 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 39/72] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:30 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:31.500551 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6ea27c6d-255d-474b-a369-8aefdd8ffc93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:31.501396 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6ea27c6d-255d-474b-a369-8aefdd8ffc93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:31.509646 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ea27c6d-255d-474b-a369-8aefdd8ffc93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:31.511608 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ea27c6d-255d-474b-a369-8aefdd8ffc93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:31.512310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ea27c6d-255d-474b-a369-8aefdd8ffc93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:31.513741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ea27c6d-255d-474b-a369-8aefdd8ffc93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:31.514325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ea27c6d-255d-474b-a369-8aefdd8ffc93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:31.514822 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ea27c6d-255d-474b-a369-8aefdd8ffc93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:31.654054 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-380e5876-05cd-489f-b72e-a0139c3b9d9e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:31.654817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-380e5876-05cd-489f-b72e-a0139c3b9d9e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:31.666013 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380e5876-05cd-489f-b72e-a0139c3b9d9e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:31.666512 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380e5876-05cd-489f-b72e-a0139c3b9d9e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:31.666954 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380e5876-05cd-489f-b72e-a0139c3b9d9e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:31.667824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380e5876-05cd-489f-b72e-a0139c3b9d9e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:31.671639 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380e5876-05cd-489f-b72e-a0139c3b9d9e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:31.672351 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380e5876-05cd-489f-b72e-a0139c3b9d9e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:31.799893 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6ea27c6d-255d-474b-a369-8aefdd8ffc93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:31.807983 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6ea27c6d-255d-474b-a369-8aefdd8ffc93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1308 microversion: 2.1 time: 0.311863 Aug 24 10:17:31.821462 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 34/73] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:31 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1308 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:31.827253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a0ca45fe-70c5-4553-9a2f-92f6e709b03f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:31.828059 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a0ca45fe-70c5-4553-9a2f-92f6e709b03f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:31.837099 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a0ca45fe-70c5-4553-9a2f-92f6e709b03f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:31.839366 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a0ca45fe-70c5-4553-9a2f-92f6e709b03f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:31.840070 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a0ca45fe-70c5-4553-9a2f-92f6e709b03f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:31.841031 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a0ca45fe-70c5-4553-9a2f-92f6e709b03f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:31.842493 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a0ca45fe-70c5-4553-9a2f-92f6e709b03f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:31.847652 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a0ca45fe-70c5-4553-9a2f-92f6e709b03f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:31.970665 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a0ca45fe-70c5-4553-9a2f-92f6e709b03f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:31.983668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a0ca45fe-70c5-4553-9a2f-92f6e709b03f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1300 microversion: 2.1 time: 0.160986 Aug 24 10:17:31.984392 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 35/74] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:31 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1300 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:32.048746 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-e4585f53-d75b-49ff-8a71-033e92d5505f req-0b2150f2-339e-4713-8911-0391cb255193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5bafeb-d393-4bf8-8c9e-734f9f9b926c", "tag": "4f928fdd-869d-4aed-a4ce-3d41cd7ec567"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:32.064717 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e4585f53-d75b-49ff-8a71-033e92d5505f req-0b2150f2-339e-4713-8911-0391cb255193 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:32.065704 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e4585f53-d75b-49ff-8a71-033e92d5505f req-0b2150f2-339e-4713-8911-0391cb255193 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:32.066541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e4585f53-d75b-49ff-8a71-033e92d5505f req-0b2150f2-339e-4713-8911-0391cb255193 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:32.090165 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-e4585f53-d75b-49ff-8a71-033e92d5505f req-0b2150f2-339e-4713-8911-0391cb255193 service nova] Creating event network-changed:4f928fdd-869d-4aed-a4ce-3d41cd7ec567 for instance 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c on hv-cinder-85427 Aug 24 10:17:32.091178 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e4585f53-d75b-49ff-8a71-033e92d5505f req-0b2150f2-339e-4713-8911-0391cb255193 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 10:17:32.091668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e4585f53-d75b-49ff-8a71-033e92d5505f req-0b2150f2-339e-4713-8911-0391cb255193 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 10:17:32.092933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-faff42f8-cf34-4eae-9bdf-3265ec7c393c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:32.093510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-faff42f8-cf34-4eae-9bdf-3265ec7c393c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:32.094354 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-faff42f8-cf34-4eae-9bdf-3265ec7c393c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:32.094933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-faff42f8-cf34-4eae-9bdf-3265ec7c393c None None] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:32.095481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-faff42f8-cf34-4eae-9bdf-3265ec7c393c None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:32.095974 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-faff42f8-cf34-4eae-9bdf-3265ec7c393c None None] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:32.109370 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.compute.rpcapi [None req-faff42f8-cf34-4eae-9bdf-3265ec7c393c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 10:17:32.110369 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-faff42f8-cf34-4eae-9bdf-3265ec7c393c None None] Releasing lock "compute-rpcapi-router" {{(pid=121270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 10:17:32.130699 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-faff42f8-cf34-4eae-9bdf-3265ec7c393c None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086681 Aug 24 10:17:32.130699 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 36/75] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:17:32.177920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-380e5876-05cd-489f-b72e-a0139c3b9d9e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:32.192523 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-380e5876-05cd-489f-b72e-a0139c3b9d9e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.542411 Aug 24 10:17:32.193663 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 40/76] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:31 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:32.297239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7de46f53-7c45-4a4d-8b79-cf6652bde4a4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:32.298183 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7de46f53-7c45-4a4d-8b79-cf6652bde4a4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:32.306159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7de46f53-7c45-4a4d-8b79-cf6652bde4a4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:32.306662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7de46f53-7c45-4a4d-8b79-cf6652bde4a4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:32.307099 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7de46f53-7c45-4a4d-8b79-cf6652bde4a4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:32.307868 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7de46f53-7c45-4a4d-8b79-cf6652bde4a4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:32.308321 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7de46f53-7c45-4a4d-8b79-cf6652bde4a4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:32.308929 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7de46f53-7c45-4a4d-8b79-cf6652bde4a4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:32.833295 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-12b48964-95f3-4291-bf79-5090d137f8cf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:32.833877 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-12b48964-95f3-4291-bf79-5090d137f8cf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:32.846150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-12b48964-95f3-4291-bf79-5090d137f8cf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:32.848633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-12b48964-95f3-4291-bf79-5090d137f8cf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:32.849303 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-12b48964-95f3-4291-bf79-5090d137f8cf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:32.851226 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-12b48964-95f3-4291-bf79-5090d137f8cf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:32.852491 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-12b48964-95f3-4291-bf79-5090d137f8cf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:32.854684 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-12b48964-95f3-4291-bf79-5090d137f8cf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:32.965882 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7de46f53-7c45-4a4d-8b79-cf6652bde4a4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:32.975281 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7de46f53-7c45-4a4d-8b79-cf6652bde4a4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.689017 Aug 24 10:17:32.975935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 37/77] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:32 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:32.976884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-12b48964-95f3-4291-bf79-5090d137f8cf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:32.991617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-12b48964-95f3-4291-bf79-5090d137f8cf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1296 microversion: 2.1 time: 0.163041 Aug 24 10:17:32.994613 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 41/78] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:32 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1296 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:33.011091 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-aafb8ab9-6644-4b4e-aa61-fd17a5978b8a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:33.012054 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-aafb8ab9-6644-4b4e-aa61-fd17a5978b8a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:33.026474 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aafb8ab9-6644-4b4e-aa61-fd17a5978b8a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:33.027328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aafb8ab9-6644-4b4e-aa61-fd17a5978b8a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:33.027968 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aafb8ab9-6644-4b4e-aa61-fd17a5978b8a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:33.028904 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aafb8ab9-6644-4b4e-aa61-fd17a5978b8a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:33.029564 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aafb8ab9-6644-4b4e-aa61-fd17a5978b8a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:33.030377 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aafb8ab9-6644-4b4e-aa61-fd17a5978b8a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:33.181727 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-aafb8ab9-6644-4b4e-aa61-fd17a5978b8a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:33.192551 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-aafb8ab9-6644-4b4e-aa61-fd17a5978b8a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1300 microversion: 2.1 time: 0.190935 Aug 24 10:17:33.194456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 38/79] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:33 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1300 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:33.214901 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-aae740c9-29d1-4c76-b208-682616ecfad7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:33.215532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-aae740c9-29d1-4c76-b208-682616ecfad7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:33.222817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aae740c9-29d1-4c76-b208-682616ecfad7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:33.224563 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aae740c9-29d1-4c76-b208-682616ecfad7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:33.225343 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aae740c9-29d1-4c76-b208-682616ecfad7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:33.226268 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aae740c9-29d1-4c76-b208-682616ecfad7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:33.227744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aae740c9-29d1-4c76-b208-682616ecfad7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:33.228586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aae740c9-29d1-4c76-b208-682616ecfad7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:33.452605 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-aae740c9-29d1-4c76-b208-682616ecfad7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:33.461554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-aae740c9-29d1-4c76-b208-682616ecfad7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.250502 Aug 24 10:17:33.462808 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 42/80] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:33 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:33.996254 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-46f7546e-c74d-41a2-82cc-3e8ad45568e0 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:33.996889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-46f7546e-c74d-41a2-82cc-3e8ad45568e0 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:34.003145 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46f7546e-c74d-41a2-82cc-3e8ad45568e0 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.003635 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46f7546e-c74d-41a2-82cc-3e8ad45568e0 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.004088 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46f7546e-c74d-41a2-82cc-3e8ad45568e0 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.005065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46f7546e-c74d-41a2-82cc-3e8ad45568e0 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.009057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46f7546e-c74d-41a2-82cc-3e8ad45568e0 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.009526 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46f7546e-c74d-41a2-82cc-3e8ad45568e0 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.020334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e4210913-5076-4dbc-b9c3-e7e95fe8450e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:34.021655 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e4210913-5076-4dbc-b9c3-e7e95fe8450e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:34.033088 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e4210913-5076-4dbc-b9c3-e7e95fe8450e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.039580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e4210913-5076-4dbc-b9c3-e7e95fe8450e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.051890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e4210913-5076-4dbc-b9c3-e7e95fe8450e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.052994 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e4210913-5076-4dbc-b9c3-e7e95fe8450e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.053532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e4210913-5076-4dbc-b9c3-e7e95fe8450e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.053966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e4210913-5076-4dbc-b9c3-e7e95fe8450e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.167990 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-46f7546e-c74d-41a2-82cc-3e8ad45568e0 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:34.177836 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-46f7546e-c74d-41a2-82cc-3e8ad45568e0 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.186226 Aug 24 10:17:34.179215 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 39/81] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:33 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:34.189412 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-da7a572d-c9fa-4577-b247-78da614858fe req-500d5230-cd9a-4ef6-92dd-d79aa0aae795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d2e447b-2106-40fb-b597-68d93b892257", "tag": "20829f3b-879d-4eb3-8b68-490ae3b6e9e3"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:34.201306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-da7a572d-c9fa-4577-b247-78da614858fe req-500d5230-cd9a-4ef6-92dd-d79aa0aae795 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.202095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-da7a572d-c9fa-4577-b247-78da614858fe req-500d5230-cd9a-4ef6-92dd-d79aa0aae795 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.202526 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-da7a572d-c9fa-4577-b247-78da614858fe req-500d5230-cd9a-4ef6-92dd-d79aa0aae795 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.216422 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-da7a572d-c9fa-4577-b247-78da614858fe req-500d5230-cd9a-4ef6-92dd-d79aa0aae795 service nova] Creating event network-changed:20829f3b-879d-4eb3-8b68-490ae3b6e9e3 for instance 9d2e447b-2106-40fb-b597-68d93b892257 on hv-cinder-85427 Aug 24 10:17:34.221628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-da7a572d-c9fa-4577-b247-78da614858fe req-500d5230-cd9a-4ef6-92dd-d79aa0aae795 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035730 Aug 24 10:17:34.222228 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 40/82] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:34.228629 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0862941a-eab2-46eb-aedf-2ee69aa4e406 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:34.229482 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0862941a-eab2-46eb-aedf-2ee69aa4e406 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:34.238534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0862941a-eab2-46eb-aedf-2ee69aa4e406 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.238534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0862941a-eab2-46eb-aedf-2ee69aa4e406 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.238534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0862941a-eab2-46eb-aedf-2ee69aa4e406 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.238534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0862941a-eab2-46eb-aedf-2ee69aa4e406 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.238805 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0862941a-eab2-46eb-aedf-2ee69aa4e406 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.240072 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0862941a-eab2-46eb-aedf-2ee69aa4e406 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.251709 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e4210913-5076-4dbc-b9c3-e7e95fe8450e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:34.260762 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e4210913-5076-4dbc-b9c3-e7e95fe8450e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.249515 Aug 24 10:17:34.261874 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 43/83] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:34 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:34.494396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a2f8655b-2e0c-4e68-a995-89f6b92a0a8d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:34.494396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a2f8655b-2e0c-4e68-a995-89f6b92a0a8d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:34.495180 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f8655b-2e0c-4e68-a995-89f6b92a0a8d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.495836 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f8655b-2e0c-4e68-a995-89f6b92a0a8d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.496272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f8655b-2e0c-4e68-a995-89f6b92a0a8d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.497296 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f8655b-2e0c-4e68-a995-89f6b92a0a8d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:34.497924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f8655b-2e0c-4e68-a995-89f6b92a0a8d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:34.498376 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f8655b-2e0c-4e68-a995-89f6b92a0a8d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:34.770313 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0862941a-eab2-46eb-aedf-2ee69aa4e406 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:34.775351 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a2f8655b-2e0c-4e68-a995-89f6b92a0a8d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:34.791695 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a2f8655b-2e0c-4e68-a995-89f6b92a0a8d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.309160 Aug 24 10:17:34.793079 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 44/84] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:34 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:34.795105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0862941a-eab2-46eb-aedf-2ee69aa4e406 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.571455 Aug 24 10:17:34.795853 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 41/85] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:34 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:35.203489 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-41362934-0f0a-480d-a918-45f946b6ca72 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:35.204249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-41362934-0f0a-480d-a918-45f946b6ca72 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:35.220777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-41362934-0f0a-480d-a918-45f946b6ca72 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.220777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-41362934-0f0a-480d-a918-45f946b6ca72 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.220777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-41362934-0f0a-480d-a918-45f946b6ca72 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.220777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-41362934-0f0a-480d-a918-45f946b6ca72 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.221211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-41362934-0f0a-480d-a918-45f946b6ca72 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.221211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-41362934-0f0a-480d-a918-45f946b6ca72 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.281778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7b65dda5-4e62-4db1-960c-c0014055eb47 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:35.282391 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7b65dda5-4e62-4db1-960c-c0014055eb47 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:35.288412 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b65dda5-4e62-4db1-960c-c0014055eb47 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.288920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b65dda5-4e62-4db1-960c-c0014055eb47 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.289397 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b65dda5-4e62-4db1-960c-c0014055eb47 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.290098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b65dda5-4e62-4db1-960c-c0014055eb47 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.290585 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b65dda5-4e62-4db1-960c-c0014055eb47 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.291012 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b65dda5-4e62-4db1-960c-c0014055eb47 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.295457 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:35.363127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-41362934-0f0a-480d-a918-45f946b6ca72 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:35.374028 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-41362934-0f0a-480d-a918-45f946b6ca72 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.175388 Aug 24 10:17:35.374835 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 45/86] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:35 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:35.436379 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7b65dda5-4e62-4db1-960c-c0014055eb47 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:35.446240 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7b65dda5-4e62-4db1-960c-c0014055eb47 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.167547 Aug 24 10:17:35.446918 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 42/87] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:35 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:35.817396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b1b50747-a17d-4112-b5e6-377d7a65148b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:35.817948 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b1b50747-a17d-4112-b5e6-377d7a65148b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:35.819756 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a6337e52-da9c-4f63-a649-0747a515fef3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:35.821040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a6337e52-da9c-4f63-a649-0747a515fef3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:35.825060 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1b50747-a17d-4112-b5e6-377d7a65148b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.825542 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1b50747-a17d-4112-b5e6-377d7a65148b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.825977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1b50747-a17d-4112-b5e6-377d7a65148b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.826860 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1b50747-a17d-4112-b5e6-377d7a65148b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.827426 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6337e52-da9c-4f63-a649-0747a515fef3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.827547 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1b50747-a17d-4112-b5e6-377d7a65148b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.827880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1b50747-a17d-4112-b5e6-377d7a65148b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.827982 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6337e52-da9c-4f63-a649-0747a515fef3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.828321 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6337e52-da9c-4f63-a649-0747a515fef3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.829043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6337e52-da9c-4f63-a649-0747a515fef3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:35.829494 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6337e52-da9c-4f63-a649-0747a515fef3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:35.829937 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6337e52-da9c-4f63-a649-0747a515fef3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:35.968148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b1b50747-a17d-4112-b5e6-377d7a65148b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:35.970937 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a6337e52-da9c-4f63-a649-0747a515fef3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:35.979565 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a6337e52-da9c-4f63-a649-0747a515fef3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.163678 Aug 24 10:17:35.979907 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b1b50747-a17d-4112-b5e6-377d7a65148b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.169404 Aug 24 10:17:35.980147 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 43/88] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:35 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:35.980478 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 46/89] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:35 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:36.398048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bbe3480f-2d95-4372-ad0f-9d71a1f9fa20 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:36.398648 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bbe3480f-2d95-4372-ad0f-9d71a1f9fa20 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:36.410062 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bbe3480f-2d95-4372-ad0f-9d71a1f9fa20 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:36.410560 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bbe3480f-2d95-4372-ad0f-9d71a1f9fa20 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:36.411013 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bbe3480f-2d95-4372-ad0f-9d71a1f9fa20 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:36.411702 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bbe3480f-2d95-4372-ad0f-9d71a1f9fa20 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:36.413042 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bbe3480f-2d95-4372-ad0f-9d71a1f9fa20 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:36.413719 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bbe3480f-2d95-4372-ad0f-9d71a1f9fa20 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:36.467353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-601ea674-6110-409b-8069-159f59f43893 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:36.474354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-601ea674-6110-409b-8069-159f59f43893 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:36.475853 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-601ea674-6110-409b-8069-159f59f43893 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:36.476507 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-601ea674-6110-409b-8069-159f59f43893 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:36.477475 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-601ea674-6110-409b-8069-159f59f43893 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:36.478913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-601ea674-6110-409b-8069-159f59f43893 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:36.479511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-601ea674-6110-409b-8069-159f59f43893 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:36.480402 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-601ea674-6110-409b-8069-159f59f43893 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:36.680009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-601ea674-6110-409b-8069-159f59f43893 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:36.693383 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-601ea674-6110-409b-8069-159f59f43893 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.229043 Aug 24 10:17:36.698680 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 47/90] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:36 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:36.711839 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bbe3480f-2d95-4372-ad0f-9d71a1f9fa20 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:36.721100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bbe3480f-2d95-4372-ad0f-9d71a1f9fa20 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.327059 Aug 24 10:17:36.721675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 44/91] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:36 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:36.725143 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-36d656bf-75b4-464f-bd33-a3cd2cee43db req-341f584a-b48f-4091-b79c-331f46eef0cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf8b275-61d0-49c9-8d08-c9aba96f38af", "tag": "3fac9a91-cee7-4983-91cf-b5bdb6470420"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:36.752017 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-36d656bf-75b4-464f-bd33-a3cd2cee43db req-341f584a-b48f-4091-b79c-331f46eef0cb service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:36.753136 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-36d656bf-75b4-464f-bd33-a3cd2cee43db req-341f584a-b48f-4091-b79c-331f46eef0cb service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:36.754295 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-36d656bf-75b4-464f-bd33-a3cd2cee43db req-341f584a-b48f-4091-b79c-331f46eef0cb service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:36.783071 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-36d656bf-75b4-464f-bd33-a3cd2cee43db req-341f584a-b48f-4091-b79c-331f46eef0cb service nova] Creating event network-changed:3fac9a91-cee7-4983-91cf-b5bdb6470420 for instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af on hv-cinder-85427 Aug 24 10:17:36.794556 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-36d656bf-75b4-464f-bd33-a3cd2cee43db req-341f584a-b48f-4091-b79c-331f46eef0cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079830 Aug 24 10:17:36.794556 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 48/92] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:37.006583 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-176858ab-b4c8-43fd-88ae-18fe1f6c40d9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:37.007286 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-176858ab-b4c8-43fd-88ae-18fe1f6c40d9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:37.011362 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-69c58a08-0206-4cb8-a63e-03a85098469c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:37.011982 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-69c58a08-0206-4cb8-a63e-03a85098469c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:37.018486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-69c58a08-0206-4cb8-a63e-03a85098469c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.019570 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-69c58a08-0206-4cb8-a63e-03a85098469c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.019570 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-69c58a08-0206-4cb8-a63e-03a85098469c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.020045 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-69c58a08-0206-4cb8-a63e-03a85098469c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.020490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-69c58a08-0206-4cb8-a63e-03a85098469c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.025086 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-69c58a08-0206-4cb8-a63e-03a85098469c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.025561 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-176858ab-b4c8-43fd-88ae-18fe1f6c40d9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.026115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-176858ab-b4c8-43fd-88ae-18fe1f6c40d9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.026574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-176858ab-b4c8-43fd-88ae-18fe1f6c40d9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.027266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-176858ab-b4c8-43fd-88ae-18fe1f6c40d9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.027715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-176858ab-b4c8-43fd-88ae-18fe1f6c40d9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.028132 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-176858ab-b4c8-43fd-88ae-18fe1f6c40d9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.046720 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=100 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:37.177577 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-176858ab-b4c8-43fd-88ae-18fe1f6c40d9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:37.187177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-69c58a08-0206-4cb8-a63e-03a85098469c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:37.187750 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-176858ab-b4c8-43fd-88ae-18fe1f6c40d9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.185561 Aug 24 10:17:37.188336 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 49/93] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:37 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:37.195534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-69c58a08-0206-4cb8-a63e-03a85098469c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.197746 Aug 24 10:17:37.196916 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 45/94] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:36 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:37.322686 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-fd08b8e8-66f4-422d-a264-2c9c0ca1ec02 req-6517a237-5ec9-4f2f-94e7-a583652e9734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29717cf7-618e-46fd-96cd-12597975a07c", "tag": "42bd17a1-04d1-4e27-90fb-1df530d8ba0b"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:37.332430 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fd08b8e8-66f4-422d-a264-2c9c0ca1ec02 req-6517a237-5ec9-4f2f-94e7-a583652e9734 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.332925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fd08b8e8-66f4-422d-a264-2c9c0ca1ec02 req-6517a237-5ec9-4f2f-94e7-a583652e9734 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.333669 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fd08b8e8-66f4-422d-a264-2c9c0ca1ec02 req-6517a237-5ec9-4f2f-94e7-a583652e9734 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.344918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-fd08b8e8-66f4-422d-a264-2c9c0ca1ec02 req-6517a237-5ec9-4f2f-94e7-a583652e9734 service nova] Creating event network-changed:42bd17a1-04d1-4e27-90fb-1df530d8ba0b for instance 29717cf7-618e-46fd-96cd-12597975a07c on hv-cinder-85427 Aug 24 10:17:37.349932 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-fd08b8e8-66f4-422d-a264-2c9c0ca1ec02 req-6517a237-5ec9-4f2f-94e7-a583652e9734 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108734 Aug 24 10:17:37.350557 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 50/95] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:37.718431 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-186ed275-6191-4fc6-85f5-6a3b09d2b01a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:37.719087 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-186ed275-6191-4fc6-85f5-6a3b09d2b01a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:37.726377 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-186ed275-6191-4fc6-85f5-6a3b09d2b01a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.726926 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-186ed275-6191-4fc6-85f5-6a3b09d2b01a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.727364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-186ed275-6191-4fc6-85f5-6a3b09d2b01a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.728712 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-186ed275-6191-4fc6-85f5-6a3b09d2b01a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.729192 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-186ed275-6191-4fc6-85f5-6a3b09d2b01a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.729618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-186ed275-6191-4fc6-85f5-6a3b09d2b01a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.742660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d2088931-e18f-47e6-afbc-950834f35b77 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:37.744175 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d2088931-e18f-47e6-afbc-950834f35b77 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:37.757971 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2088931-e18f-47e6-afbc-950834f35b77 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.758472 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2088931-e18f-47e6-afbc-950834f35b77 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.759668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2088931-e18f-47e6-afbc-950834f35b77 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:37.760801 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2088931-e18f-47e6-afbc-950834f35b77 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:37.763215 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2088931-e18f-47e6-afbc-950834f35b77 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:37.763680 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d2088931-e18f-47e6-afbc-950834f35b77 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:38.112534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-186ed275-6191-4fc6-85f5-6a3b09d2b01a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:38.121470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-186ed275-6191-4fc6-85f5-6a3b09d2b01a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.406842 Aug 24 10:17:38.122748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 46/96] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:37 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:38.211084 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-fb2748eb-ca06-494f-a331-fa45625c57b4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:38.212449 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-fb2748eb-ca06-494f-a331-fa45625c57b4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:38.224377 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fb2748eb-ca06-494f-a331-fa45625c57b4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:38.225243 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fb2748eb-ca06-494f-a331-fa45625c57b4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:38.225847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fb2748eb-ca06-494f-a331-fa45625c57b4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:38.226777 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fb2748eb-ca06-494f-a331-fa45625c57b4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:38.228154 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fb2748eb-ca06-494f-a331-fa45625c57b4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:38.229890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fb2748eb-ca06-494f-a331-fa45625c57b4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:38.300875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d2088931-e18f-47e6-afbc-950834f35b77 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:38.311015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d2088931-e18f-47e6-afbc-950834f35b77 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.572871 Aug 24 10:17:38.314913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 51/97] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:37 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:38.327961 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d6c7fbc8-1f11-4269-ab0f-5f1a061b1bca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:38.333398 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d6c7fbc8-1f11-4269-ab0f-5f1a061b1bca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:38.355358 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6c7fbc8-1f11-4269-ab0f-5f1a061b1bca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:38.356515 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6c7fbc8-1f11-4269-ab0f-5f1a061b1bca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:38.357187 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6c7fbc8-1f11-4269-ab0f-5f1a061b1bca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:38.357969 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6c7fbc8-1f11-4269-ab0f-5f1a061b1bca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:38.358490 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6c7fbc8-1f11-4269-ab0f-5f1a061b1bca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:38.358919 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6c7fbc8-1f11-4269-ab0f-5f1a061b1bca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:38.693798 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d6c7fbc8-1f11-4269-ab0f-5f1a061b1bca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:38.711043 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d6c7fbc8-1f11-4269-ab0f-5f1a061b1bca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.391273 Aug 24 10:17:38.711043 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 52/98] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:38 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:38.770944 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-fb2748eb-ca06-494f-a331-fa45625c57b4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:38.781319 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-fb2748eb-ca06-494f-a331-fa45625c57b4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.574757 Aug 24 10:17:38.793699 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 47/99] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:38 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:39.142762 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1a84f71b-6ea7-4376-85dc-419769906b9f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:39.143659 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1a84f71b-6ea7-4376-85dc-419769906b9f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:39.155764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a84f71b-6ea7-4376-85dc-419769906b9f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.161364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a84f71b-6ea7-4376-85dc-419769906b9f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.161364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a84f71b-6ea7-4376-85dc-419769906b9f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.161364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a84f71b-6ea7-4376-85dc-419769906b9f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.161364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a84f71b-6ea7-4376-85dc-419769906b9f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.162357 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a84f71b-6ea7-4376-85dc-419769906b9f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.359930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-a927da33-fdfd-4c7a-9b5b-1bb60a1f9739 req-fd5f491a-4266-4391-9c65-58392b3d9818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634", "name": "network-vif-plugged", "status": "completed", "tag": "f28dce31-d9c2-4fa3-a64a-63c9f2a85bd8"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:39.376573 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-a927da33-fdfd-4c7a-9b5b-1bb60a1f9739 req-fd5f491a-4266-4391-9c65-58392b3d9818 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.377267 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-a927da33-fdfd-4c7a-9b5b-1bb60a1f9739 req-fd5f491a-4266-4391-9c65-58392b3d9818 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.378302 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-a927da33-fdfd-4c7a-9b5b-1bb60a1f9739 req-fd5f491a-4266-4391-9c65-58392b3d9818 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.392256 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-a927da33-fdfd-4c7a-9b5b-1bb60a1f9739 req-fd5f491a-4266-4391-9c65-58392b3d9818 service nova] Creating event network-vif-plugged:f28dce31-d9c2-4fa3-a64a-63c9f2a85bd8 for instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 on hv-cinder-85427 Aug 24 10:17:39.398879 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-a927da33-fdfd-4c7a-9b5b-1bb60a1f9739 req-fd5f491a-4266-4391-9c65-58392b3d9818 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.476923 Aug 24 10:17:39.404307 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 53/100] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:39.410422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-56eda90d-61a0-46f7-8fd8-3cdaefd7ffd8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:39.411309 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-56eda90d-61a0-46f7-8fd8-3cdaefd7ffd8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:39.419980 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-56eda90d-61a0-46f7-8fd8-3cdaefd7ffd8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.420749 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-56eda90d-61a0-46f7-8fd8-3cdaefd7ffd8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.421420 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-56eda90d-61a0-46f7-8fd8-3cdaefd7ffd8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.422368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-56eda90d-61a0-46f7-8fd8-3cdaefd7ffd8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.422950 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-56eda90d-61a0-46f7-8fd8-3cdaefd7ffd8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.423652 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-56eda90d-61a0-46f7-8fd8-3cdaefd7ffd8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.429223 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1a84f71b-6ea7-4376-85dc-419769906b9f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:39.443631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1a84f71b-6ea7-4376-85dc-419769906b9f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.301084 Aug 24 10:17:39.444409 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 48/101] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:39 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:39.642796 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-56eda90d-61a0-46f7-8fd8-3cdaefd7ffd8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:39.654474 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-56eda90d-61a0-46f7-8fd8-3cdaefd7ffd8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.248666 Aug 24 10:17:39.655651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 54/102] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:39 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:39.730776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7786300e-4e74-40cb-9041-edaee6c92655 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:39.731467 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7786300e-4e74-40cb-9041-edaee6c92655 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:39.738406 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7786300e-4e74-40cb-9041-edaee6c92655 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.738896 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7786300e-4e74-40cb-9041-edaee6c92655 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.739342 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7786300e-4e74-40cb-9041-edaee6c92655 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.740349 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7786300e-4e74-40cb-9041-edaee6c92655 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.741141 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7786300e-4e74-40cb-9041-edaee6c92655 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.741594 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7786300e-4e74-40cb-9041-edaee6c92655 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.815715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ee5673fb-0948-4a48-9e5e-f2ced9d23354 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:39.816635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ee5673fb-0948-4a48-9e5e-f2ced9d23354 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:39.848433 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee5673fb-0948-4a48-9e5e-f2ced9d23354 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.849002 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee5673fb-0948-4a48-9e5e-f2ced9d23354 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.858437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee5673fb-0948-4a48-9e5e-f2ced9d23354 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.858437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee5673fb-0948-4a48-9e5e-f2ced9d23354 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:39.858437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee5673fb-0948-4a48-9e5e-f2ced9d23354 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:39.858437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee5673fb-0948-4a48-9e5e-f2ced9d23354 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:39.926589 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7786300e-4e74-40cb-9041-edaee6c92655 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:39.938929 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7786300e-4e74-40cb-9041-edaee6c92655 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.211663 Aug 24 10:17:39.955907 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 49/103] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:39 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:40.167547 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-ee5673fb-0948-4a48-9e5e-f2ced9d23354 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:40.179219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ee5673fb-0948-4a48-9e5e-f2ced9d23354 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.367293 Aug 24 10:17:40.180124 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 55/104] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:39 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:40.468378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cd831098-085f-4bc8-ae4a-836742bd0c5f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:40.469295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cd831098-085f-4bc8-ae4a-836742bd0c5f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:40.476102 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd831098-085f-4bc8-ae4a-836742bd0c5f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.476808 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd831098-085f-4bc8-ae4a-836742bd0c5f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.478259 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd831098-085f-4bc8-ae4a-836742bd0c5f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:40.479389 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd831098-085f-4bc8-ae4a-836742bd0c5f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.480156 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd831098-085f-4bc8-ae4a-836742bd0c5f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.480890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd831098-085f-4bc8-ae4a-836742bd0c5f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:40.648947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cd831098-085f-4bc8-ae4a-836742bd0c5f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:40.652086 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cd831098-085f-4bc8-ae4a-836742bd0c5f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.189890 Aug 24 10:17:40.653534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 50/105] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:40 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:40.678153 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3032a98c-9e35-48b7-b0c7-1651309c0051 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:40.678932 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3032a98c-9e35-48b7-b0c7-1651309c0051 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:40.694542 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3032a98c-9e35-48b7-b0c7-1651309c0051 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.694542 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3032a98c-9e35-48b7-b0c7-1651309c0051 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.694542 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3032a98c-9e35-48b7-b0c7-1651309c0051 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:40.694542 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3032a98c-9e35-48b7-b0c7-1651309c0051 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.694865 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3032a98c-9e35-48b7-b0c7-1651309c0051 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.694865 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3032a98c-9e35-48b7-b0c7-1651309c0051 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:40.856628 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3032a98c-9e35-48b7-b0c7-1651309c0051 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:40.864391 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3032a98c-9e35-48b7-b0c7-1651309c0051 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.189943 Aug 24 10:17:40.865515 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 56/106] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:40 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:40.962853 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-39e82ef1-aa02-44cf-a364-7aa7ab2680a5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:40.963546 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-39e82ef1-aa02-44cf-a364-7aa7ab2680a5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:40.970369 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e82ef1-aa02-44cf-a364-7aa7ab2680a5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.971574 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e82ef1-aa02-44cf-a364-7aa7ab2680a5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.972802 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e82ef1-aa02-44cf-a364-7aa7ab2680a5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:40.974829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e82ef1-aa02-44cf-a364-7aa7ab2680a5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:40.977991 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e82ef1-aa02-44cf-a364-7aa7ab2680a5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:40.978802 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e82ef1-aa02-44cf-a364-7aa7ab2680a5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.117381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-39e82ef1-aa02-44cf-a364-7aa7ab2680a5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:41.126910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-39e82ef1-aa02-44cf-a364-7aa7ab2680a5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.169199 Aug 24 10:17:41.147843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 51/107] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:40 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:41.202995 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d73a95a0-eeb3-4245-b757-75b54e51ce09 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:41.203621 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d73a95a0-eeb3-4245-b757-75b54e51ce09 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:41.211487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d73a95a0-eeb3-4245-b757-75b54e51ce09 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.212188 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d73a95a0-eeb3-4245-b757-75b54e51ce09 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.212634 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d73a95a0-eeb3-4245-b757-75b54e51ce09 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.213373 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d73a95a0-eeb3-4245-b757-75b54e51ce09 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.213831 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d73a95a0-eeb3-4245-b757-75b54e51ce09 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.214257 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d73a95a0-eeb3-4245-b757-75b54e51ce09 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.421005 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-fc44e025-07cf-4fb8-aaab-5bc27233edae req-004e4033-2dec-461c-82c2-de30f2cc685c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5bafeb-d393-4bf8-8c9e-734f9f9b926c", "name": "network-vif-plugged", "status": "completed", "tag": "4f928fdd-869d-4aed-a4ce-3d41cd7ec567"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:41.437228 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-fc44e025-07cf-4fb8-aaab-5bc27233edae req-004e4033-2dec-461c-82c2-de30f2cc685c service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.437779 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-fc44e025-07cf-4fb8-aaab-5bc27233edae req-004e4033-2dec-461c-82c2-de30f2cc685c service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.438439 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-fc44e025-07cf-4fb8-aaab-5bc27233edae req-004e4033-2dec-461c-82c2-de30f2cc685c service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.450286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-fc44e025-07cf-4fb8-aaab-5bc27233edae req-004e4033-2dec-461c-82c2-de30f2cc685c service nova] Creating event network-vif-plugged:4f928fdd-869d-4aed-a4ce-3d41cd7ec567 for instance 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c on hv-cinder-85427 Aug 24 10:17:41.472450 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-fc44e025-07cf-4fb8-aaab-5bc27233edae req-004e4033-2dec-461c-82c2-de30f2cc685c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057194 Aug 24 10:17:41.473813 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 52/108] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:17:41.504685 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d73a95a0-eeb3-4245-b757-75b54e51ce09 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:41.517483 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d73a95a0-eeb3-4245-b757-75b54e51ce09 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.320625 Aug 24 10:17:41.521385 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 57/109] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:41 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:41.674511 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-63d7e27a-6034-4b80-9eb8-407f0cf29f16 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:41.675268 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-63d7e27a-6034-4b80-9eb8-407f0cf29f16 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:41.683402 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63d7e27a-6034-4b80-9eb8-407f0cf29f16 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.683895 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63d7e27a-6034-4b80-9eb8-407f0cf29f16 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.684418 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63d7e27a-6034-4b80-9eb8-407f0cf29f16 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.685553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63d7e27a-6034-4b80-9eb8-407f0cf29f16 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.685553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63d7e27a-6034-4b80-9eb8-407f0cf29f16 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.686126 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63d7e27a-6034-4b80-9eb8-407f0cf29f16 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.834827 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-63d7e27a-6034-4b80-9eb8-407f0cf29f16 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:41.843081 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-63d7e27a-6034-4b80-9eb8-407f0cf29f16 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.173367 Aug 24 10:17:41.843666 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 53/110] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:41 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:41.885680 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-47c3d959-5532-4a60-8f05-617ac1a1f153 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:41.886425 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-47c3d959-5532-4a60-8f05-617ac1a1f153 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:41.892366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-47c3d959-5532-4a60-8f05-617ac1a1f153 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.892840 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-47c3d959-5532-4a60-8f05-617ac1a1f153 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.893292 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-47c3d959-5532-4a60-8f05-617ac1a1f153 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:41.893972 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-47c3d959-5532-4a60-8f05-617ac1a1f153 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:41.894414 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-47c3d959-5532-4a60-8f05-617ac1a1f153 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:41.894824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-47c3d959-5532-4a60-8f05-617ac1a1f153 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:42.105604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-47c3d959-5532-4a60-8f05-617ac1a1f153 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:42.113512 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-47c3d959-5532-4a60-8f05-617ac1a1f153 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.231579 Aug 24 10:17:42.115799 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 58/111] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:41 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:42.148175 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cb6b1f2e-05fc-4176-9278-7ba85c9d51a3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:42.149722 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cb6b1f2e-05fc-4176-9278-7ba85c9d51a3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:42.153337 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:42.156943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb6b1f2e-05fc-4176-9278-7ba85c9d51a3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:42.166387 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb6b1f2e-05fc-4176-9278-7ba85c9d51a3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:42.166387 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb6b1f2e-05fc-4176-9278-7ba85c9d51a3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:42.166387 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb6b1f2e-05fc-4176-9278-7ba85c9d51a3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:42.166387 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb6b1f2e-05fc-4176-9278-7ba85c9d51a3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:42.166977 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb6b1f2e-05fc-4176-9278-7ba85c9d51a3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:42.296706 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cb6b1f2e-05fc-4176-9278-7ba85c9d51a3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:42.304703 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cb6b1f2e-05fc-4176-9278-7ba85c9d51a3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.160339 Aug 24 10:17:42.305371 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 54/112] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:42 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:42.542971 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e0d0cc45-71fa-4114-97b1-87ff66f5764c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:42.543584 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e0d0cc45-71fa-4114-97b1-87ff66f5764c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:42.549460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0d0cc45-71fa-4114-97b1-87ff66f5764c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:42.550001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0d0cc45-71fa-4114-97b1-87ff66f5764c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:42.575688 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0d0cc45-71fa-4114-97b1-87ff66f5764c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:42.576692 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0d0cc45-71fa-4114-97b1-87ff66f5764c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:42.577210 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0d0cc45-71fa-4114-97b1-87ff66f5764c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:42.577777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0d0cc45-71fa-4114-97b1-87ff66f5764c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:42.797837 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e0d0cc45-71fa-4114-97b1-87ff66f5764c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:42.811875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e0d0cc45-71fa-4114-97b1-87ff66f5764c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1322 microversion: 2.1 time: 0.272766 Aug 24 10:17:42.812473 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 59/113] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:42 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:42.864563 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-07e38dae-6dc7-4dd9-bc58-feec14c11be0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:42.865673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-07e38dae-6dc7-4dd9-bc58-feec14c11be0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:42.874281 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07e38dae-6dc7-4dd9-bc58-feec14c11be0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:42.875429 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07e38dae-6dc7-4dd9-bc58-feec14c11be0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:42.876062 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07e38dae-6dc7-4dd9-bc58-feec14c11be0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:42.877609 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07e38dae-6dc7-4dd9-bc58-feec14c11be0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:42.878140 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07e38dae-6dc7-4dd9-bc58-feec14c11be0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:42.879171 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07e38dae-6dc7-4dd9-bc58-feec14c11be0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:43.076227 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-07e38dae-6dc7-4dd9-bc58-feec14c11be0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:43.084418 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-07e38dae-6dc7-4dd9-bc58-feec14c11be0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.224793 Aug 24 10:17:43.085623 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 55/114] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:42 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:43.135988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4ae00820-3aa4-46cd-bb46-3d5c6f1f15da tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:43.137279 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4ae00820-3aa4-46cd-bb46-3d5c6f1f15da tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:43.143600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4ae00820-3aa4-46cd-bb46-3d5c6f1f15da tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:43.144289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4ae00820-3aa4-46cd-bb46-3d5c6f1f15da tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:43.145227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4ae00820-3aa4-46cd-bb46-3d5c6f1f15da tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:43.146120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4ae00820-3aa4-46cd-bb46-3d5c6f1f15da tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:43.146768 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4ae00820-3aa4-46cd-bb46-3d5c6f1f15da tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:43.147333 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4ae00820-3aa4-46cd-bb46-3d5c6f1f15da tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:43.330281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4ae00820-3aa4-46cd-bb46-3d5c6f1f15da tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:43.335539 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5e4a1b7c-c0af-48d7-8c6d-297e064bb34b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:43.336155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5e4a1b7c-c0af-48d7-8c6d-297e064bb34b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:43.338710 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4ae00820-3aa4-46cd-bb46-3d5c6f1f15da tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.207481 Aug 24 10:17:43.345439 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 60/115] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:43 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:43.348622 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e4a1b7c-c0af-48d7-8c6d-297e064bb34b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:43.349167 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e4a1b7c-c0af-48d7-8c6d-297e064bb34b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:43.349807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e4a1b7c-c0af-48d7-8c6d-297e064bb34b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:43.353218 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e4a1b7c-c0af-48d7-8c6d-297e064bb34b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:43.353693 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e4a1b7c-c0af-48d7-8c6d-297e064bb34b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:43.354123 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e4a1b7c-c0af-48d7-8c6d-297e064bb34b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:43.506612 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-f4d4f425-a4e1-498b-af15-321e0e6ae0c0 req-3f9ef337-80cd-491f-a20c-34f2d831fe83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2e447b-2106-40fb-b597-68d93b892257", "name": "network-vif-plugged", "status": "completed", "tag": "20829f3b-879d-4eb3-8b68-490ae3b6e9e3"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:43.511873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5e4a1b7c-c0af-48d7-8c6d-297e064bb34b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:43.519608 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f4d4f425-a4e1-498b-af15-321e0e6ae0c0 req-3f9ef337-80cd-491f-a20c-34f2d831fe83 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:43.520223 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f4d4f425-a4e1-498b-af15-321e0e6ae0c0 req-3f9ef337-80cd-491f-a20c-34f2d831fe83 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:43.520758 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f4d4f425-a4e1-498b-af15-321e0e6ae0c0 req-3f9ef337-80cd-491f-a20c-34f2d831fe83 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:43.521154 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5e4a1b7c-c0af-48d7-8c6d-297e064bb34b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.189180 Aug 24 10:17:43.521987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 56/116] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:43 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:43.533559 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-f4d4f425-a4e1-498b-af15-321e0e6ae0c0 req-3f9ef337-80cd-491f-a20c-34f2d831fe83 service nova] Creating event network-vif-plugged:20829f3b-879d-4eb3-8b68-490ae3b6e9e3 for instance 9d2e447b-2106-40fb-b597-68d93b892257 on hv-cinder-85427 Aug 24 10:17:43.539249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-f4d4f425-a4e1-498b-af15-321e0e6ae0c0 req-3f9ef337-80cd-491f-a20c-34f2d831fe83 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036833 Aug 24 10:17:43.540518 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 61/117] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:17:43.833469 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1d5c6ca2-10c2-44b5-9a82-79be6d86025d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:43.834112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1d5c6ca2-10c2-44b5-9a82-79be6d86025d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:43.841214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ca2-10c2-44b5-9a82-79be6d86025d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:43.841966 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ca2-10c2-44b5-9a82-79be6d86025d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:43.842404 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ca2-10c2-44b5-9a82-79be6d86025d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:43.843135 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ca2-10c2-44b5-9a82-79be6d86025d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:43.843870 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ca2-10c2-44b5-9a82-79be6d86025d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:43.844455 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1d5c6ca2-10c2-44b5-9a82-79be6d86025d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.014840 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1d5c6ca2-10c2-44b5-9a82-79be6d86025d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:44.023471 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1d5c6ca2-10c2-44b5-9a82-79be6d86025d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1516 microversion: 2.1 time: 0.193881 Aug 24 10:17:44.026763 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 57/118] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:43 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:44.053919 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-971cfc90-605c-43d9-8973-3c0db61ce5f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:44.058379 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-971cfc90-605c-43d9-8973-3c0db61ce5f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:44.075723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-971cfc90-605c-43d9-8973-3c0db61ce5f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.078579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-971cfc90-605c-43d9-8973-3c0db61ce5f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.080216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-971cfc90-605c-43d9-8973-3c0db61ce5f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.081005 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-971cfc90-605c-43d9-8973-3c0db61ce5f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.084202 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-971cfc90-605c-43d9-8973-3c0db61ce5f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.084663 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-971cfc90-605c-43d9-8973-3c0db61ce5f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.106033 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9df24199-c162-4a62-9ce9-3816171dd7cc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:44.106679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9df24199-c162-4a62-9ce9-3816171dd7cc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:44.114952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9df24199-c162-4a62-9ce9-3816171dd7cc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.115452 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9df24199-c162-4a62-9ce9-3816171dd7cc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.115886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9df24199-c162-4a62-9ce9-3816171dd7cc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.116836 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9df24199-c162-4a62-9ce9-3816171dd7cc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.117319 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9df24199-c162-4a62-9ce9-3816171dd7cc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.117862 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9df24199-c162-4a62-9ce9-3816171dd7cc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.216703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-971cfc90-605c-43d9-8973-3c0db61ce5f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lazy-loading 'flavor' on Instance uuid 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:17:44.323145 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9df24199-c162-4a62-9ce9-3816171dd7cc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:44.341537 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9df24199-c162-4a62-9ce9-3816171dd7cc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.239167 Aug 24 10:17:44.342145 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 58/119] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:44 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:44.362836 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6e6a7efc-2e04-4ac5-985d-a4467db111e2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:44.362836 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6e6a7efc-2e04-4ac5-985d-a4467db111e2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:44.368382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e6a7efc-2e04-4ac5-985d-a4467db111e2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.368892 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e6a7efc-2e04-4ac5-985d-a4467db111e2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.369331 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e6a7efc-2e04-4ac5-985d-a4467db111e2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.370031 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e6a7efc-2e04-4ac5-985d-a4467db111e2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.370479 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e6a7efc-2e04-4ac5-985d-a4467db111e2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.370895 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e6a7efc-2e04-4ac5-985d-a4467db111e2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.388905 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:44.527266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6e6a7efc-2e04-4ac5-985d-a4467db111e2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:44.546481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6e6a7efc-2e04-4ac5-985d-a4467db111e2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.190153 Aug 24 10:17:44.561606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 59/120] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:44 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:44.572801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3301e557-cb72-490b-973c-25a5f70281c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:44.573693 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3301e557-cb72-490b-973c-25a5f70281c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:44.580395 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3301e557-cb72-490b-973c-25a5f70281c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.580897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3301e557-cb72-490b-973c-25a5f70281c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.581514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3301e557-cb72-490b-973c-25a5f70281c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.582204 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3301e557-cb72-490b-973c-25a5f70281c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.582648 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3301e557-cb72-490b-973c-25a5f70281c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.583061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3301e557-cb72-490b-973c-25a5f70281c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.742485 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3301e557-cb72-490b-973c-25a5f70281c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:44.750616 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3301e557-cb72-490b-973c-25a5f70281c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.187618 Aug 24 10:17:44.752043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 60/121] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:44 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:44.756253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-971cfc90-605c-43d9-8973-3c0db61ce5f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c/action" status: 200 len: 32 microversion: 2.1 time: 0.707603 Aug 24 10:17:44.772128 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 62/122] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:17:44 2022] POST /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c/action => generated 32 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:17:44.780622 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-54c35afe-702c-4fc4-83ea-38dc12d1780f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:44.781315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-54c35afe-702c-4fc4-83ea-38dc12d1780f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:44.787200 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54c35afe-702c-4fc4-83ea-38dc12d1780f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.787673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54c35afe-702c-4fc4-83ea-38dc12d1780f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.788120 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54c35afe-702c-4fc4-83ea-38dc12d1780f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.788795 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54c35afe-702c-4fc4-83ea-38dc12d1780f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:44.789275 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54c35afe-702c-4fc4-83ea-38dc12d1780f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:44.790857 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54c35afe-702c-4fc4-83ea-38dc12d1780f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:44.969790 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-54c35afe-702c-4fc4-83ea-38dc12d1780f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:44.985065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-54c35afe-702c-4fc4-83ea-38dc12d1780f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.208141 Aug 24 10:17:44.987001 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 61/123] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:44 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:45.363214 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6beb18d8-7cdc-4f8d-8fd3-a926b3bd3ec2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:45.364016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-6beb18d8-7cdc-4f8d-8fd3-a926b3bd3ec2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:45.379897 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6beb18d8-7cdc-4f8d-8fd3-a926b3bd3ec2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:45.380398 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6beb18d8-7cdc-4f8d-8fd3-a926b3bd3ec2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:45.381169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6beb18d8-7cdc-4f8d-8fd3-a926b3bd3ec2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:45.381587 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6beb18d8-7cdc-4f8d-8fd3-a926b3bd3ec2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:45.382044 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6beb18d8-7cdc-4f8d-8fd3-a926b3bd3ec2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:45.382466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6beb18d8-7cdc-4f8d-8fd3-a926b3bd3ec2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:45.522448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6beb18d8-7cdc-4f8d-8fd3-a926b3bd3ec2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:45.530463 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-6beb18d8-7cdc-4f8d-8fd3-a926b3bd3ec2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.171590 Aug 24 10:17:45.531035 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 63/124] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:45 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:45.569047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-513365bf-2c84-4079-bb8e-ae3039c02322 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:45.569645 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-513365bf-2c84-4079-bb8e-ae3039c02322 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:45.576360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-513365bf-2c84-4079-bb8e-ae3039c02322 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:45.576837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-513365bf-2c84-4079-bb8e-ae3039c02322 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:45.577288 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-513365bf-2c84-4079-bb8e-ae3039c02322 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:45.577970 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-513365bf-2c84-4079-bb8e-ae3039c02322 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:45.578416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-513365bf-2c84-4079-bb8e-ae3039c02322 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:45.578829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-513365bf-2c84-4079-bb8e-ae3039c02322 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:45.712522 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-513365bf-2c84-4079-bb8e-ae3039c02322 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:45.720613 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-513365bf-2c84-4079-bb8e-ae3039c02322 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.155673 Aug 24 10:17:45.721265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 62/125] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:45 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:45.791169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-33713afb-be2c-4226-90af-7461b7fc67db tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:45.791789 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-33713afb-be2c-4226-90af-7461b7fc67db tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:45.798283 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33713afb-be2c-4226-90af-7461b7fc67db tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:45.798759 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33713afb-be2c-4226-90af-7461b7fc67db tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:45.799512 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33713afb-be2c-4226-90af-7461b7fc67db tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:45.800211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33713afb-be2c-4226-90af-7461b7fc67db tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:45.800662 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33713afb-be2c-4226-90af-7461b7fc67db tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:45.801488 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33713afb-be2c-4226-90af-7461b7fc67db tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:45.952022 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-33713afb-be2c-4226-90af-7461b7fc67db tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:45.963128 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-33713afb-be2c-4226-90af-7461b7fc67db tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.176522 Aug 24 10:17:45.963814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 64/126] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:45 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:46.007840 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7fbb0c15-26ee-40e4-b39e-5ba2a02caaaf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:46.008456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7fbb0c15-26ee-40e4-b39e-5ba2a02caaaf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:46.014819 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7fbb0c15-26ee-40e4-b39e-5ba2a02caaaf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.015299 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7fbb0c15-26ee-40e4-b39e-5ba2a02caaaf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.015728 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7fbb0c15-26ee-40e4-b39e-5ba2a02caaaf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.016427 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7fbb0c15-26ee-40e4-b39e-5ba2a02caaaf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.016907 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7fbb0c15-26ee-40e4-b39e-5ba2a02caaaf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.017657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7fbb0c15-26ee-40e4-b39e-5ba2a02caaaf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.160410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7fbb0c15-26ee-40e4-b39e-5ba2a02caaaf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:46.169263 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7fbb0c15-26ee-40e4-b39e-5ba2a02caaaf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.165561 Aug 24 10:17:46.169844 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 63/127] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:46 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:46.552048 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d77698dd-138e-4543-928c-63f5fb669d69 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:46.553491 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d77698dd-138e-4543-928c-63f5fb669d69 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:46.560476 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d77698dd-138e-4543-928c-63f5fb669d69 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.561011 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d77698dd-138e-4543-928c-63f5fb669d69 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.561567 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d77698dd-138e-4543-928c-63f5fb669d69 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.562437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d77698dd-138e-4543-928c-63f5fb669d69 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.562889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d77698dd-138e-4543-928c-63f5fb669d69 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.563465 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d77698dd-138e-4543-928c-63f5fb669d69 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.697506 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d77698dd-138e-4543-928c-63f5fb669d69 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:46.705272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d77698dd-138e-4543-928c-63f5fb669d69 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.157444 Aug 24 10:17:46.705834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 65/128] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:46 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:46.743767 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bb33a45d-bbdc-46cf-bc81-459050be7208 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:46.744730 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bb33a45d-bbdc-46cf-bc81-459050be7208 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:46.750770 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb33a45d-bbdc-46cf-bc81-459050be7208 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.751249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb33a45d-bbdc-46cf-bc81-459050be7208 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.751723 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb33a45d-bbdc-46cf-bc81-459050be7208 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.752436 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb33a45d-bbdc-46cf-bc81-459050be7208 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.752916 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb33a45d-bbdc-46cf-bc81-459050be7208 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.753340 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb33a45d-bbdc-46cf-bc81-459050be7208 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.910159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bb33a45d-bbdc-46cf-bc81-459050be7208 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:46.918123 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bb33a45d-bbdc-46cf-bc81-459050be7208 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.178908 Aug 24 10:17:46.918773 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 64/129] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:46 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:46.984155 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a320ccce-e3a1-4efd-a601-ba74ff7e0ec6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:46.984772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a320ccce-e3a1-4efd-a601-ba74ff7e0ec6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:46.990865 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a320ccce-e3a1-4efd-a601-ba74ff7e0ec6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.991346 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a320ccce-e3a1-4efd-a601-ba74ff7e0ec6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.992035 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a320ccce-e3a1-4efd-a601-ba74ff7e0ec6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.992718 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a320ccce-e3a1-4efd-a601-ba74ff7e0ec6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:46.993929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a320ccce-e3a1-4efd-a601-ba74ff7e0ec6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:46.994786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a320ccce-e3a1-4efd-a601-ba74ff7e0ec6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:46.999462 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:47.141690 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a320ccce-e3a1-4efd-a601-ba74ff7e0ec6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:47.155734 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a320ccce-e3a1-4efd-a601-ba74ff7e0ec6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.175420 Aug 24 10:17:47.156321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 66/130] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:46 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:47.194192 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-36bb1979-b32d-4736-a1ef-9bbe80699138 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:47.201943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-36bb1979-b32d-4736-a1ef-9bbe80699138 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:47.203393 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-36bb1979-b32d-4736-a1ef-9bbe80699138 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:47.204050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-36bb1979-b32d-4736-a1ef-9bbe80699138 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:47.204642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-36bb1979-b32d-4736-a1ef-9bbe80699138 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:47.205524 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-36bb1979-b32d-4736-a1ef-9bbe80699138 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:47.206391 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-36bb1979-b32d-4736-a1ef-9bbe80699138 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:47.207025 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-36bb1979-b32d-4736-a1ef-9bbe80699138 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:47.360582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-36bb1979-b32d-4736-a1ef-9bbe80699138 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:47.368987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-36bb1979-b32d-4736-a1ef-9bbe80699138 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.179705 Aug 24 10:17:47.369964 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 65/131] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:47 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:47.725848 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e8a3ebda-f879-466d-993d-056bbde92737 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:47.726542 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e8a3ebda-f879-466d-993d-056bbde92737 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:47.734223 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8a3ebda-f879-466d-993d-056bbde92737 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:47.734719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8a3ebda-f879-466d-993d-056bbde92737 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:47.735151 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8a3ebda-f879-466d-993d-056bbde92737 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:47.735851 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8a3ebda-f879-466d-993d-056bbde92737 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:47.736302 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8a3ebda-f879-466d-993d-056bbde92737 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:47.736724 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8a3ebda-f879-466d-993d-056bbde92737 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:47.882354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e8a3ebda-f879-466d-993d-056bbde92737 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:47.890461 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e8a3ebda-f879-466d-993d-056bbde92737 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.168370 Aug 24 10:17:47.891224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 67/132] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:47 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:47.939404 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-13eaf449-1e73-4c1e-8af6-5177ad12cc62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:47.940058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-13eaf449-1e73-4c1e-8af6-5177ad12cc62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:47.946350 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-13eaf449-1e73-4c1e-8af6-5177ad12cc62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:47.954188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-13eaf449-1e73-4c1e-8af6-5177ad12cc62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:47.954188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-13eaf449-1e73-4c1e-8af6-5177ad12cc62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:47.954188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-13eaf449-1e73-4c1e-8af6-5177ad12cc62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:47.954188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-13eaf449-1e73-4c1e-8af6-5177ad12cc62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:47.954518 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-13eaf449-1e73-4c1e-8af6-5177ad12cc62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:48.081228 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-13eaf449-1e73-4c1e-8af6-5177ad12cc62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:48.108663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-13eaf449-1e73-4c1e-8af6-5177ad12cc62 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1315 microversion: 2.1 time: 0.172899 Aug 24 10:17:48.109778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 66/133] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:47 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:48.176885 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2ca52934-4ac3-4b51-9ce7-50365b8b265f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:48.177666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2ca52934-4ac3-4b51-9ce7-50365b8b265f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:48.186838 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ca52934-4ac3-4b51-9ce7-50365b8b265f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:48.187321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ca52934-4ac3-4b51-9ce7-50365b8b265f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:48.187744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ca52934-4ac3-4b51-9ce7-50365b8b265f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:48.188428 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ca52934-4ac3-4b51-9ce7-50365b8b265f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:48.188889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ca52934-4ac3-4b51-9ce7-50365b8b265f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:48.189325 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ca52934-4ac3-4b51-9ce7-50365b8b265f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:48.206084 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-e6ec7c42-109d-49bd-a968-65ace5082661 req-ab6e68fb-383e-46be-99cf-8fc52fb5d062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf8b275-61d0-49c9-8d08-c9aba96f38af", "name": "network-vif-plugged", "status": "completed", "tag": "3fac9a91-cee7-4983-91cf-b5bdb6470420"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:48.217052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e6ec7c42-109d-49bd-a968-65ace5082661 req-ab6e68fb-383e-46be-99cf-8fc52fb5d062 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:48.217547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e6ec7c42-109d-49bd-a968-65ace5082661 req-ab6e68fb-383e-46be-99cf-8fc52fb5d062 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:48.217968 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e6ec7c42-109d-49bd-a968-65ace5082661 req-ab6e68fb-383e-46be-99cf-8fc52fb5d062 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:48.230883 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-e6ec7c42-109d-49bd-a968-65ace5082661 req-ab6e68fb-383e-46be-99cf-8fc52fb5d062 service nova] Creating event network-vif-plugged:3fac9a91-cee7-4983-91cf-b5bdb6470420 for instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af on hv-cinder-85427 Aug 24 10:17:48.241092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-e6ec7c42-109d-49bd-a968-65ace5082661 req-ab6e68fb-383e-46be-99cf-8fc52fb5d062 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034989 Aug 24 10:17:48.246223 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 67/134] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:17:48.375790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2ca52934-4ac3-4b51-9ce7-50365b8b265f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:48.385653 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2ca52934-4ac3-4b51-9ce7-50365b8b265f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.211963 Aug 24 10:17:48.392247 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d572665d-3001-4d0a-b3a2-d5075ef96b57 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:48.393107 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d572665d-3001-4d0a-b3a2-d5075ef96b57 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:48.400556 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d572665d-3001-4d0a-b3a2-d5075ef96b57 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:48.407017 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d572665d-3001-4d0a-b3a2-d5075ef96b57 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:48.407017 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d572665d-3001-4d0a-b3a2-d5075ef96b57 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:48.407017 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d572665d-3001-4d0a-b3a2-d5075ef96b57 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:48.407017 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d572665d-3001-4d0a-b3a2-d5075ef96b57 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:48.407595 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d572665d-3001-4d0a-b3a2-d5075ef96b57 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:48.409064 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 68/135] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:48 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:48.557546 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d572665d-3001-4d0a-b3a2-d5075ef96b57 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:48.565061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d572665d-3001-4d0a-b3a2-d5075ef96b57 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.178615 Aug 24 10:17:48.565629 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 68/136] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:48 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:48.933527 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-832c6707-81c1-4ba2-a787-f8a3d0e1216c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:48.933527 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-832c6707-81c1-4ba2-a787-f8a3d0e1216c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:48.933527 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-832c6707-81c1-4ba2-a787-f8a3d0e1216c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:48.933527 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-832c6707-81c1-4ba2-a787-f8a3d0e1216c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:48.934292 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-832c6707-81c1-4ba2-a787-f8a3d0e1216c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:48.934564 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-832c6707-81c1-4ba2-a787-f8a3d0e1216c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:48.935013 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-832c6707-81c1-4ba2-a787-f8a3d0e1216c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:48.935440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-832c6707-81c1-4ba2-a787-f8a3d0e1216c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:49.136795 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5b1f4209-9570-4627-a9ea-3706053b9713 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:49.138100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5b1f4209-9570-4627-a9ea-3706053b9713 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:49.152612 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b1f4209-9570-4627-a9ea-3706053b9713 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:49.153524 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b1f4209-9570-4627-a9ea-3706053b9713 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:49.154242 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b1f4209-9570-4627-a9ea-3706053b9713 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:49.155744 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b1f4209-9570-4627-a9ea-3706053b9713 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:49.156358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b1f4209-9570-4627-a9ea-3706053b9713 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:49.157036 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b1f4209-9570-4627-a9ea-3706053b9713 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:49.182006 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-832c6707-81c1-4ba2-a787-f8a3d0e1216c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:49.204769 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-832c6707-81c1-4ba2-a787-f8a3d0e1216c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.282768 Aug 24 10:17:49.208138 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 69/137] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:48 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:49.323094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5b1f4209-9570-4627-a9ea-3706053b9713 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:49.331146 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5b1f4209-9570-4627-a9ea-3706053b9713 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1503 microversion: 2.1 time: 0.203664 Aug 24 10:17:49.331724 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 69/138] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:49 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:49.410690 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0c500ae1-2a72-4e17-b59c-982c5ccbadc0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:49.411411 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0c500ae1-2a72-4e17-b59c-982c5ccbadc0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:49.417751 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c500ae1-2a72-4e17-b59c-982c5ccbadc0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:49.418232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c500ae1-2a72-4e17-b59c-982c5ccbadc0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:49.418665 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c500ae1-2a72-4e17-b59c-982c5ccbadc0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:49.419353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c500ae1-2a72-4e17-b59c-982c5ccbadc0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:49.419803 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c500ae1-2a72-4e17-b59c-982c5ccbadc0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:49.420223 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c500ae1-2a72-4e17-b59c-982c5ccbadc0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:49.568522 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0c500ae1-2a72-4e17-b59c-982c5ccbadc0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:49.584589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0c500ae1-2a72-4e17-b59c-982c5ccbadc0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.177615 Aug 24 10:17:49.586008 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 70/139] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:49 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:49.597517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-504d0428-4b6d-45d8-a6e9-eb9d9bbb9b6f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:49.597517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-504d0428-4b6d-45d8-a6e9-eb9d9bbb9b6f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:49.597517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-504d0428-4b6d-45d8-a6e9-eb9d9bbb9b6f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:49.597517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-504d0428-4b6d-45d8-a6e9-eb9d9bbb9b6f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:49.598402 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-504d0428-4b6d-45d8-a6e9-eb9d9bbb9b6f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:49.598402 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-504d0428-4b6d-45d8-a6e9-eb9d9bbb9b6f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:49.605542 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-504d0428-4b6d-45d8-a6e9-eb9d9bbb9b6f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:49.605542 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-504d0428-4b6d-45d8-a6e9-eb9d9bbb9b6f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:49.747799 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-504d0428-4b6d-45d8-a6e9-eb9d9bbb9b6f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:49.755685 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-504d0428-4b6d-45d8-a6e9-eb9d9bbb9b6f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.172252 Aug 24 10:17:49.756255 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 70/140] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:49 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:50.229796 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-adc2922f-be81-49bd-bd13-6ae8ebe16c6f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:50.230446 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-adc2922f-be81-49bd-bd13-6ae8ebe16c6f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:50.236806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-adc2922f-be81-49bd-bd13-6ae8ebe16c6f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:50.237311 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-adc2922f-be81-49bd-bd13-6ae8ebe16c6f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:50.237738 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-adc2922f-be81-49bd-bd13-6ae8ebe16c6f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:50.242514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-adc2922f-be81-49bd-bd13-6ae8ebe16c6f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:50.242514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-adc2922f-be81-49bd-bd13-6ae8ebe16c6f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:50.242514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-adc2922f-be81-49bd-bd13-6ae8ebe16c6f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:50.255911 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-16033081-087e-45b6-a53b-49d6aa3b6b30 req-9940aacb-c026-47ac-9d47-cb8dd53abf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29717cf7-618e-46fd-96cd-12597975a07c", "name": "network-vif-plugged", "status": "completed", "tag": "42bd17a1-04d1-4e27-90fb-1df530d8ba0b"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:50.269171 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-16033081-087e-45b6-a53b-49d6aa3b6b30 req-9940aacb-c026-47ac-9d47-cb8dd53abf9a service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:50.269171 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-16033081-087e-45b6-a53b-49d6aa3b6b30 req-9940aacb-c026-47ac-9d47-cb8dd53abf9a service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:50.269171 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-16033081-087e-45b6-a53b-49d6aa3b6b30 req-9940aacb-c026-47ac-9d47-cb8dd53abf9a service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:50.301624 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-16033081-087e-45b6-a53b-49d6aa3b6b30 req-9940aacb-c026-47ac-9d47-cb8dd53abf9a service nova] Creating event network-vif-plugged:42bd17a1-04d1-4e27-90fb-1df530d8ba0b for instance 29717cf7-618e-46fd-96cd-12597975a07c on hv-cinder-85427 Aug 24 10:17:50.308650 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-16033081-087e-45b6-a53b-49d6aa3b6b30 req-9940aacb-c026-47ac-9d47-cb8dd53abf9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056370 Aug 24 10:17:50.312030 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 71/141] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:17:50.432981 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-adc2922f-be81-49bd-bd13-6ae8ebe16c6f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:50.440669 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-adc2922f-be81-49bd-bd13-6ae8ebe16c6f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.215385 Aug 24 10:17:50.441269 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 71/142] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:50 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:50.616218 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-df727906-7e43-407a-aa5d-419a13ddccf8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:50.624432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-df727906-7e43-407a-aa5d-419a13ddccf8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:50.624432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df727906-7e43-407a-aa5d-419a13ddccf8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:50.624909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df727906-7e43-407a-aa5d-419a13ddccf8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:50.625248 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df727906-7e43-407a-aa5d-419a13ddccf8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:50.625938 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df727906-7e43-407a-aa5d-419a13ddccf8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:50.626375 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df727906-7e43-407a-aa5d-419a13ddccf8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:50.626786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df727906-7e43-407a-aa5d-419a13ddccf8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:50.779030 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-fc8f3efc-4637-4faf-97eb-40aa0f5ac60e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:50.779729 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-fc8f3efc-4637-4faf-97eb-40aa0f5ac60e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:50.787221 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc8f3efc-4637-4faf-97eb-40aa0f5ac60e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:50.788053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc8f3efc-4637-4faf-97eb-40aa0f5ac60e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:50.788725 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc8f3efc-4637-4faf-97eb-40aa0f5ac60e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:50.789698 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc8f3efc-4637-4faf-97eb-40aa0f5ac60e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:50.790612 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc8f3efc-4637-4faf-97eb-40aa0f5ac60e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:50.791359 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc8f3efc-4637-4faf-97eb-40aa0f5ac60e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:50.838670 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-df727906-7e43-407a-aa5d-419a13ddccf8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:50.849323 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-df727906-7e43-407a-aa5d-419a13ddccf8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1368 microversion: 2.1 time: 0.240187 Aug 24 10:17:50.863923 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 72/143] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:50 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:50.939275 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fc8f3efc-4637-4faf-97eb-40aa0f5ac60e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:50.947757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-fc8f3efc-4637-4faf-97eb-40aa0f5ac60e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.173727 Aug 24 10:17:50.948326 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 72/144] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:50 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:51.433806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-539e9607-26ad-4ff5-83f7-a5c1ae22e802 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b467f27-5219-4f9d-9a84-bdfcd2242e69"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:51.436969 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-539e9607-26ad-4ff5-83f7-a5c1ae22e802 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:51.443357 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-539e9607-26ad-4ff5-83f7-a5c1ae22e802 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:51.443843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-539e9607-26ad-4ff5-83f7-a5c1ae22e802 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:51.444285 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-539e9607-26ad-4ff5-83f7-a5c1ae22e802 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:51.447303 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-539e9607-26ad-4ff5-83f7-a5c1ae22e802 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:51.447303 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-539e9607-26ad-4ff5-83f7-a5c1ae22e802 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:51.447303 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-539e9607-26ad-4ff5-83f7-a5c1ae22e802 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:51.461615 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-86d12b3b-a625-4824-8114-8268a2c381f5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:51.463048 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-86d12b3b-a625-4824-8114-8268a2c381f5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:51.469831 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86d12b3b-a625-4824-8114-8268a2c381f5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:51.470539 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86d12b3b-a625-4824-8114-8268a2c381f5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:51.470983 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86d12b3b-a625-4824-8114-8268a2c381f5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:51.471689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86d12b3b-a625-4824-8114-8268a2c381f5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:51.472193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86d12b3b-a625-4824-8114-8268a2c381f5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:51.472819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86d12b3b-a625-4824-8114-8268a2c381f5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:51.625469 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-86d12b3b-a625-4824-8114-8268a2c381f5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:51.634325 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-86d12b3b-a625-4824-8114-8268a2c381f5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1363 microversion: 2.1 time: 0.176515 Aug 24 10:17:51.634890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 73/145] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:51 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:51.871913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f6497f7c-afaf-4529-9494-7850e3cbba6e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:51.872679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f6497f7c-afaf-4529-9494-7850e3cbba6e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:51.879857 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6497f7c-afaf-4529-9494-7850e3cbba6e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:51.881773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6497f7c-afaf-4529-9494-7850e3cbba6e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:51.882631 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6497f7c-afaf-4529-9494-7850e3cbba6e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:51.883417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6497f7c-afaf-4529-9494-7850e3cbba6e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:51.884279 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6497f7c-afaf-4529-9494-7850e3cbba6e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:51.884927 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6497f7c-afaf-4529-9494-7850e3cbba6e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.029334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f6497f7c-afaf-4529-9494-7850e3cbba6e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:52.038062 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f6497f7c-afaf-4529-9494-7850e3cbba6e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1558 microversion: 2.1 time: 0.170638 Aug 24 10:17:52.038743 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 74/146] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:51 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:52.045193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7bfe4b80-8f35-4990-9fee-2ef93a253c56 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:52.046167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7bfe4b80-8f35-4990-9fee-2ef93a253c56 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:52.052597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bfe4b80-8f35-4990-9fee-2ef93a253c56 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.053277 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bfe4b80-8f35-4990-9fee-2ef93a253c56 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.054253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bfe4b80-8f35-4990-9fee-2ef93a253c56 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.055531 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bfe4b80-8f35-4990-9fee-2ef93a253c56 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.055989 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bfe4b80-8f35-4990-9fee-2ef93a253c56 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.056476 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bfe4b80-8f35-4990-9fee-2ef93a253c56 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.233084 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7bfe4b80-8f35-4990-9fee-2ef93a253c56 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:52.242302 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7bfe4b80-8f35-4990-9fee-2ef93a253c56 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.202100 Aug 24 10:17:52.243526 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 75/147] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:52 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:52.250761 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-927f718e-312b-4cf8-8720-f98a442a2827 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:52.250761 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-927f718e-312b-4cf8-8720-f98a442a2827 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:52.253316 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=100 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:52.256714 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-927f718e-312b-4cf8-8720-f98a442a2827 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.257345 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-927f718e-312b-4cf8-8720-f98a442a2827 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.257822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-927f718e-312b-4cf8-8720-f98a442a2827 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.259102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-927f718e-312b-4cf8-8720-f98a442a2827 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.259624 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-927f718e-312b-4cf8-8720-f98a442a2827 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.260115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-927f718e-312b-4cf8-8720-f98a442a2827 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.354760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-927f718e-312b-4cf8-8720-f98a442a2827 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109917 Aug 24 10:17:52.355368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 76/148] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Aug 24 10:17:52 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:52.670510 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-380ffb44-a4de-4966-8cb5-affd33faefd9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:52.671968 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-380ffb44-a4de-4966-8cb5-affd33faefd9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:52.689006 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380ffb44-a4de-4966-8cb5-affd33faefd9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.691100 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380ffb44-a4de-4966-8cb5-affd33faefd9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.691100 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380ffb44-a4de-4966-8cb5-affd33faefd9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:52.691100 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380ffb44-a4de-4966-8cb5-affd33faefd9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:52.691388 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380ffb44-a4de-4966-8cb5-affd33faefd9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:52.691817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-380ffb44-a4de-4966-8cb5-affd33faefd9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.051478 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-380ffb44-a4de-4966-8cb5-affd33faefd9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:53.061954 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-380ffb44-a4de-4966-8cb5-affd33faefd9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1549 microversion: 2.1 time: 0.410607 Aug 24 10:17:53.069603 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 77/149] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:52 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1549 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:53.089378 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7ca83ca1-9419-406c-a9b6-4ad6c8275c75 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:53.090170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7ca83ca1-9419-406c-a9b6-4ad6c8275c75 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:53.106630 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-539e9607-26ad-4ff5-83f7-a5c1ae22e802 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "POST /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.676826 Aug 24 10:17:53.107261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 73/150] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:17:51 2022] POST /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257/os-volume_attachments => generated 194 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:53.114697 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7ca83ca1-9419-406c-a9b6-4ad6c8275c75 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:53.115605 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7ca83ca1-9419-406c-a9b6-4ad6c8275c75 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:53.116509 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7ca83ca1-9419-406c-a9b6-4ad6c8275c75 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.117479 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7ca83ca1-9419-406c-a9b6-4ad6c8275c75 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:53.119360 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7ca83ca1-9419-406c-a9b6-4ad6c8275c75 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:53.120435 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7ca83ca1-9419-406c-a9b6-4ad6c8275c75 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.270447 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-555ed5e1-2b77-43e7-8c5b-974c16398c71 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:53.273382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-555ed5e1-2b77-43e7-8c5b-974c16398c71 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:53.288876 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-555ed5e1-2b77-43e7-8c5b-974c16398c71 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:53.289459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-555ed5e1-2b77-43e7-8c5b-974c16398c71 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:53.289862 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-555ed5e1-2b77-43e7-8c5b-974c16398c71 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.290807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-555ed5e1-2b77-43e7-8c5b-974c16398c71 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:53.291450 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-555ed5e1-2b77-43e7-8c5b-974c16398c71 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:53.292075 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-555ed5e1-2b77-43e7-8c5b-974c16398c71 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:53.462958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7ca83ca1-9419-406c-a9b6-4ad6c8275c75 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.378179 Aug 24 10:17:53.464361 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 78/151] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Aug 24 10:17:53 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/os-interface => generated 284 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:53.638606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-555ed5e1-2b77-43e7-8c5b-974c16398c71 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:53.645916 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-555ed5e1-2b77-43e7-8c5b-974c16398c71 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.384440 Aug 24 10:17:53.646806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 74/152] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:53 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:54.199402 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-b401ae96-6fd0-44fa-b0ff-2c7918296a16 req-6f23f0ef-f678-4901-8492-939c510f01b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf8b275-61d0-49c9-8d08-c9aba96f38af", "tag": "3fac9a91-cee7-4983-91cf-b5bdb6470420"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:54.210033 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-b401ae96-6fd0-44fa-b0ff-2c7918296a16 req-6f23f0ef-f678-4901-8492-939c510f01b7 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:54.210806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-b401ae96-6fd0-44fa-b0ff-2c7918296a16 req-6f23f0ef-f678-4901-8492-939c510f01b7 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:54.211446 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-b401ae96-6fd0-44fa-b0ff-2c7918296a16 req-6f23f0ef-f678-4901-8492-939c510f01b7 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:54.225103 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-b401ae96-6fd0-44fa-b0ff-2c7918296a16 req-6f23f0ef-f678-4901-8492-939c510f01b7 service nova] Creating event network-changed:3fac9a91-cee7-4983-91cf-b5bdb6470420 for instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af on hv-cinder-85427 Aug 24 10:17:54.231476 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-b401ae96-6fd0-44fa-b0ff-2c7918296a16 req-6f23f0ef-f678-4901-8492-939c510f01b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036731 Aug 24 10:17:54.235896 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 79/153] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:54.669099 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d72c566a-377a-4fef-90f5-f9b7843390e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:54.670264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d72c566a-377a-4fef-90f5-f9b7843390e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:54.672991 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:54.686358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d72c566a-377a-4fef-90f5-f9b7843390e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:54.687092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d72c566a-377a-4fef-90f5-f9b7843390e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:54.692786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d72c566a-377a-4fef-90f5-f9b7843390e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:54.692786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d72c566a-377a-4fef-90f5-f9b7843390e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:54.692786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d72c566a-377a-4fef-90f5-f9b7843390e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:54.692786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d72c566a-377a-4fef-90f5-f9b7843390e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:54.954395 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d72c566a-377a-4fef-90f5-f9b7843390e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:54.974707 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d72c566a-377a-4fef-90f5-f9b7843390e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.304858 Aug 24 10:17:54.975356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 75/154] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:54 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:55.435500 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-835a6a10-66b1-4777-9c80-93a058188acd req-0b2b6cd5-8436-4510-8e1c-a7d662671424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29717cf7-618e-46fd-96cd-12597975a07c", "tag": "42bd17a1-04d1-4e27-90fb-1df530d8ba0b"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:17:55.449209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-835a6a10-66b1-4777-9c80-93a058188acd req-0b2b6cd5-8436-4510-8e1c-a7d662671424 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:55.450293 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-835a6a10-66b1-4777-9c80-93a058188acd req-0b2b6cd5-8436-4510-8e1c-a7d662671424 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:55.451374 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-835a6a10-66b1-4777-9c80-93a058188acd req-0b2b6cd5-8436-4510-8e1c-a7d662671424 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:55.468666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-835a6a10-66b1-4777-9c80-93a058188acd req-0b2b6cd5-8436-4510-8e1c-a7d662671424 service nova] Creating event network-changed:42bd17a1-04d1-4e27-90fb-1df530d8ba0b for instance 29717cf7-618e-46fd-96cd-12597975a07c on hv-cinder-85427 Aug 24 10:17:55.477440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-835a6a10-66b1-4777-9c80-93a058188acd req-0b2b6cd5-8436-4510-8e1c-a7d662671424 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046440 Aug 24 10:17:55.478707 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 80/155] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:55.996348 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-dc9812ba-a556-4d0c-99a4-ef5dbb411234 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:55.997012 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-dc9812ba-a556-4d0c-99a4-ef5dbb411234 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:56.011496 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dc9812ba-a556-4d0c-99a4-ef5dbb411234 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:56.012211 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dc9812ba-a556-4d0c-99a4-ef5dbb411234 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:56.013396 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dc9812ba-a556-4d0c-99a4-ef5dbb411234 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:56.015910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dc9812ba-a556-4d0c-99a4-ef5dbb411234 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:56.016393 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dc9812ba-a556-4d0c-99a4-ef5dbb411234 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:56.016829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dc9812ba-a556-4d0c-99a4-ef5dbb411234 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:56.028515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:56.313503 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-dc9812ba-a556-4d0c-99a4-ef5dbb411234 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:56.323550 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-dc9812ba-a556-4d0c-99a4-ef5dbb411234 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.331256 Aug 24 10:17:56.333558 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 76/156] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:55 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:57.359673 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-11de4c14-eedb-4551-9407-e8c6675c0bf8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:57.360625 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-11de4c14-eedb-4551-9407-e8c6675c0bf8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:57.367265 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11de4c14-eedb-4551-9407-e8c6675c0bf8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:57.368599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11de4c14-eedb-4551-9407-e8c6675c0bf8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:57.369568 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11de4c14-eedb-4551-9407-e8c6675c0bf8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:57.370339 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11de4c14-eedb-4551-9407-e8c6675c0bf8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:57.370942 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11de4c14-eedb-4551-9407-e8c6675c0bf8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:57.371383 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11de4c14-eedb-4551-9407-e8c6675c0bf8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:57.515187 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-11de4c14-eedb-4551-9407-e8c6675c0bf8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:57.523302 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-11de4c14-eedb-4551-9407-e8c6675c0bf8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.167801 Aug 24 10:17:57.523905 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 81/157] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:57 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:58.545242 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a903ec7a-58a5-4d74-8153-8ebbcd7b1b5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:58.546344 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a903ec7a-58a5-4d74-8153-8ebbcd7b1b5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:58.554121 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a903ec7a-58a5-4d74-8153-8ebbcd7b1b5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:58.554961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a903ec7a-58a5-4d74-8153-8ebbcd7b1b5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:58.555505 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a903ec7a-58a5-4d74-8153-8ebbcd7b1b5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:58.556301 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a903ec7a-58a5-4d74-8153-8ebbcd7b1b5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:58.556821 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a903ec7a-58a5-4d74-8153-8ebbcd7b1b5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:58.557327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a903ec7a-58a5-4d74-8153-8ebbcd7b1b5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:58.715908 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a903ec7a-58a5-4d74-8153-8ebbcd7b1b5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:58.723497 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a903ec7a-58a5-4d74-8153-8ebbcd7b1b5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.182005 Aug 24 10:17:58.724069 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 77/158] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:58 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:59.749713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d6a85883-2d22-46d1-ba5c-046101d7a42a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:59.750353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d6a85883-2d22-46d1-ba5c-046101d7a42a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:59.756344 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6a85883-2d22-46d1-ba5c-046101d7a42a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:59.756825 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6a85883-2d22-46d1-ba5c-046101d7a42a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:59.757299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6a85883-2d22-46d1-ba5c-046101d7a42a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:59.757995 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6a85883-2d22-46d1-ba5c-046101d7a42a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:59.758449 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6a85883-2d22-46d1-ba5c-046101d7a42a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:59.758987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6a85883-2d22-46d1-ba5c-046101d7a42a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:59.889932 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d6a85883-2d22-46d1-ba5c-046101d7a42a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:59.897678 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d6a85883-2d22-46d1-ba5c-046101d7a42a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.151865 Aug 24 10:17:59.899085 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 82/159] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:59 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:00.920633 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-75b68cfe-0068-46db-94cd-3887228cf18a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:00.921289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-75b68cfe-0068-46db-94cd-3887228cf18a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:00.928970 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75b68cfe-0068-46db-94cd-3887228cf18a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:00.929463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75b68cfe-0068-46db-94cd-3887228cf18a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:00.930153 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75b68cfe-0068-46db-94cd-3887228cf18a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:00.930988 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75b68cfe-0068-46db-94cd-3887228cf18a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:00.931445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75b68cfe-0068-46db-94cd-3887228cf18a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:00.931875 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75b68cfe-0068-46db-94cd-3887228cf18a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.093013 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-75b68cfe-0068-46db-94cd-3887228cf18a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:01.102158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-75b68cfe-0068-46db-94cd-3887228cf18a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.184814 Aug 24 10:18:01.103016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 78/160] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:00 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:02.124286 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-87b79a1f-3537-4432-8888-e1d29807c0af tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:02.124930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-87b79a1f-3537-4432-8888-e1d29807c0af tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:02.130982 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b79a1f-3537-4432-8888-e1d29807c0af tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.131494 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b79a1f-3537-4432-8888-e1d29807c0af tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.131876 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b79a1f-3537-4432-8888-e1d29807c0af tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.132570 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b79a1f-3537-4432-8888-e1d29807c0af tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.133651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b79a1f-3537-4432-8888-e1d29807c0af tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.134104 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b79a1f-3537-4432-8888-e1d29807c0af tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.273297 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-87b79a1f-3537-4432-8888-e1d29807c0af tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:02.281448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-87b79a1f-3537-4432-8888-e1d29807c0af tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.160900 Aug 24 10:18:02.282026 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 83/161] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:02 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:03.303693 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1251759a-e97b-41b7-a505-b6bd85bd79cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:03.304126 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1251759a-e97b-41b7-a505-b6bd85bd79cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:03.319410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1251759a-e97b-41b7-a505-b6bd85bd79cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.319410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1251759a-e97b-41b7-a505-b6bd85bd79cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.319410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1251759a-e97b-41b7-a505-b6bd85bd79cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.319410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1251759a-e97b-41b7-a505-b6bd85bd79cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.320100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1251759a-e97b-41b7-a505-b6bd85bd79cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.320100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1251759a-e97b-41b7-a505-b6bd85bd79cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.435083 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-60c01e88-f622-4cae-9742-c8d6a3dc7850 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:03.435652 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-60c01e88-f622-4cae-9742-c8d6a3dc7850 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:03.441607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-60c01e88-f622-4cae-9742-c8d6a3dc7850 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.442091 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-60c01e88-f622-4cae-9742-c8d6a3dc7850 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.442525 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-60c01e88-f622-4cae-9742-c8d6a3dc7850 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.443211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-60c01e88-f622-4cae-9742-c8d6a3dc7850 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.443661 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-60c01e88-f622-4cae-9742-c8d6a3dc7850 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.444080 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-60c01e88-f622-4cae-9742-c8d6a3dc7850 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.457720 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1251759a-e97b-41b7-a505-b6bd85bd79cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:03.466055 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1251759a-e97b-41b7-a505-b6bd85bd79cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.166354 Aug 24 10:18:03.466974 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 79/162] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:03 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:03.469137 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-60c01e88-f622-4cae-9742-c8d6a3dc7850 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:18:03.472060 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=100 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:03.831653 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-60c01e88-f622-4cae-9742-c8d6a3dc7850 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 204 len: 0 microversion: 2.1 time: 0.400185 Aug 24 10:18:03.832338 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 84/163] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:03 2022] DELETE /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:18:03.840983 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d046faed-729f-46de-8e4e-15b2ad6b1de9 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:03.841595 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d046faed-729f-46de-8e4e-15b2ad6b1de9 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:03.847466 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d046faed-729f-46de-8e4e-15b2ad6b1de9 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.847946 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d046faed-729f-46de-8e4e-15b2ad6b1de9 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.848381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d046faed-729f-46de-8e4e-15b2ad6b1de9 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.849092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d046faed-729f-46de-8e4e-15b2ad6b1de9 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:03.849551 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d046faed-729f-46de-8e4e-15b2ad6b1de9 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:03.850000 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d046faed-729f-46de-8e4e-15b2ad6b1de9 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:03.983735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d046faed-729f-46de-8e4e-15b2ad6b1de9 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:03.992981 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d046faed-729f-46de-8e4e-15b2ad6b1de9 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1555 microversion: 2.1 time: 0.155220 Aug 24 10:18:03.993609 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 80/164] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:03 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:04.488823 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c4019bf8-aff2-4299-b567-32de2d86f74b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:04.489689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c4019bf8-aff2-4299-b567-32de2d86f74b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:04.497233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4019bf8-aff2-4299-b567-32de2d86f74b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:04.497722 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4019bf8-aff2-4299-b567-32de2d86f74b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:04.498157 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4019bf8-aff2-4299-b567-32de2d86f74b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:04.498855 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4019bf8-aff2-4299-b567-32de2d86f74b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:04.499310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4019bf8-aff2-4299-b567-32de2d86f74b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:04.499736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4019bf8-aff2-4299-b567-32de2d86f74b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:04.636722 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c4019bf8-aff2-4299-b567-32de2d86f74b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:04.644493 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c4019bf8-aff2-4299-b567-32de2d86f74b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.160438 Aug 24 10:18:04.645085 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 85/165] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:04 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:05.014760 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7a041272-7411-48ee-a0bc-0d9d9316c755 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:05.015381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7a041272-7411-48ee-a0bc-0d9d9316c755 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:05.021831 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a041272-7411-48ee-a0bc-0d9d9316c755 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:05.022310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a041272-7411-48ee-a0bc-0d9d9316c755 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:05.022737 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a041272-7411-48ee-a0bc-0d9d9316c755 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:05.023809 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a041272-7411-48ee-a0bc-0d9d9316c755 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:05.024607 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a041272-7411-48ee-a0bc-0d9d9316c755 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:05.025074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7a041272-7411-48ee-a0bc-0d9d9316c755 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:05.154337 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7a041272-7411-48ee-a0bc-0d9d9316c755 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:05.162474 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7a041272-7411-48ee-a0bc-0d9d9316c755 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1555 microversion: 2.1 time: 0.151679 Aug 24 10:18:05.163037 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 81/166] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:05 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:05.666456 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2a88733a-d743-4731-9ac4-55fb7f8ea6a3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:05.667079 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2a88733a-d743-4731-9ac4-55fb7f8ea6a3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:05.673235 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2a88733a-d743-4731-9ac4-55fb7f8ea6a3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:05.673816 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2a88733a-d743-4731-9ac4-55fb7f8ea6a3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:05.674255 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2a88733a-d743-4731-9ac4-55fb7f8ea6a3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:05.675126 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2a88733a-d743-4731-9ac4-55fb7f8ea6a3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:05.675636 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2a88733a-d743-4731-9ac4-55fb7f8ea6a3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:05.676099 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2a88733a-d743-4731-9ac4-55fb7f8ea6a3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:05.837018 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2a88733a-d743-4731-9ac4-55fb7f8ea6a3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:05.849926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2a88733a-d743-4731-9ac4-55fb7f8ea6a3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.187121 Aug 24 10:18:05.850920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 86/167] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:05 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:06.184911 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-49f733f2-9a86-49d8-831f-a74a6d4d4490 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:06.185454 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-49f733f2-9a86-49d8-831f-a74a6d4d4490 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:06.191898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f733f2-9a86-49d8-831f-a74a6d4d4490 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:06.192384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f733f2-9a86-49d8-831f-a74a6d4d4490 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:06.192824 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f733f2-9a86-49d8-831f-a74a6d4d4490 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:06.193545 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f733f2-9a86-49d8-831f-a74a6d4d4490 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:06.193999 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f733f2-9a86-49d8-831f-a74a6d4d4490 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:06.194423 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f733f2-9a86-49d8-831f-a74a6d4d4490 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:06.326943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-49f733f2-9a86-49d8-831f-a74a6d4d4490 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:06.337391 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-49f733f2-9a86-49d8-831f-a74a6d4d4490 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1555 microversion: 2.1 time: 0.156487 Aug 24 10:18:06.338009 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 82/168] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:06 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:06.881611 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3d79f83f-dbfd-443c-9726-65420ce5647a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:06.881611 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3d79f83f-dbfd-443c-9726-65420ce5647a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:06.881611 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3d79f83f-dbfd-443c-9726-65420ce5647a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:06.881611 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3d79f83f-dbfd-443c-9726-65420ce5647a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:06.883495 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3d79f83f-dbfd-443c-9726-65420ce5647a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:06.883495 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3d79f83f-dbfd-443c-9726-65420ce5647a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:06.883495 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3d79f83f-dbfd-443c-9726-65420ce5647a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:06.883495 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3d79f83f-dbfd-443c-9726-65420ce5647a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.017193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3d79f83f-dbfd-443c-9726-65420ce5647a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:07.025477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3d79f83f-dbfd-443c-9726-65420ce5647a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.156746 Aug 24 10:18:07.026059 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 87/169] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:06 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:07.360509 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-792afd02-7352-4215-8415-30783291f120 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:07.361262 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-792afd02-7352-4215-8415-30783291f120 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:07.368827 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-792afd02-7352-4215-8415-30783291f120 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.369336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-792afd02-7352-4215-8415-30783291f120 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.369762 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-792afd02-7352-4215-8415-30783291f120 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.370797 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-792afd02-7352-4215-8415-30783291f120 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:07.371249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-792afd02-7352-4215-8415-30783291f120 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:07.371670 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-792afd02-7352-4215-8415-30783291f120 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:07.513021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-792afd02-7352-4215-8415-30783291f120 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:07.521625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-792afd02-7352-4215-8415-30783291f120 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1555 microversion: 2.1 time: 0.166543 Aug 24 10:18:07.522360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 83/170] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:07 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:08.047163 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9228240f-0a21-46b8-90eb-9ba8336bd503 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:08.047775 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9228240f-0a21-46b8-90eb-9ba8336bd503 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:08.053743 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9228240f-0a21-46b8-90eb-9ba8336bd503 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:08.054224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9228240f-0a21-46b8-90eb-9ba8336bd503 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:08.055234 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9228240f-0a21-46b8-90eb-9ba8336bd503 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:08.055933 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9228240f-0a21-46b8-90eb-9ba8336bd503 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:08.056386 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9228240f-0a21-46b8-90eb-9ba8336bd503 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:08.056814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9228240f-0a21-46b8-90eb-9ba8336bd503 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:08.206875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9228240f-0a21-46b8-90eb-9ba8336bd503 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:08.215297 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9228240f-0a21-46b8-90eb-9ba8336bd503 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.172034 Aug 24 10:18:08.215880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 88/171] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:08 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:08.545917 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a87c89ee-75aa-43f8-b6fb-efbfb2faf9cc tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:08.547595 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a87c89ee-75aa-43f8-b6fb-efbfb2faf9cc tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:08.553134 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a87c89ee-75aa-43f8-b6fb-efbfb2faf9cc tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:08.553613 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a87c89ee-75aa-43f8-b6fb-efbfb2faf9cc tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:08.554044 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a87c89ee-75aa-43f8-b6fb-efbfb2faf9cc tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:08.555432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a87c89ee-75aa-43f8-b6fb-efbfb2faf9cc tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:08.555878 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a87c89ee-75aa-43f8-b6fb-efbfb2faf9cc tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:08.556305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a87c89ee-75aa-43f8-b6fb-efbfb2faf9cc tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:08.688562 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a87c89ee-75aa-43f8-b6fb-efbfb2faf9cc tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:08.697363 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a87c89ee-75aa-43f8-b6fb-efbfb2faf9cc tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1555 microversion: 2.1 time: 0.155200 Aug 24 10:18:08.701489 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 84/172] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:08 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:09.236406 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ed607d03-32bc-4f7c-a232-0ba207ea3970 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:09.237045 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ed607d03-32bc-4f7c-a232-0ba207ea3970 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:09.245622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed607d03-32bc-4f7c-a232-0ba207ea3970 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.246126 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed607d03-32bc-4f7c-a232-0ba207ea3970 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.246549 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed607d03-32bc-4f7c-a232-0ba207ea3970 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.247269 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed607d03-32bc-4f7c-a232-0ba207ea3970 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.247740 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed607d03-32bc-4f7c-a232-0ba207ea3970 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.248161 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed607d03-32bc-4f7c-a232-0ba207ea3970 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.490057 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-ed607d03-32bc-4f7c-a232-0ba207ea3970 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:09.503313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ed607d03-32bc-4f7c-a232-0ba207ea3970 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.270802 Aug 24 10:18:09.503930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 89/173] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:09 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:09.721328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-32e578d5-d34f-4ef5-b708-34b2182fce61 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:09.722088 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-32e578d5-d34f-4ef5-b708-34b2182fce61 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:09.749250 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-32e578d5-d34f-4ef5-b708-34b2182fce61 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.750152 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-32e578d5-d34f-4ef5-b708-34b2182fce61 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.756478 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-32e578d5-d34f-4ef5-b708-34b2182fce61 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.760227 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-32e578d5-d34f-4ef5-b708-34b2182fce61 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.761231 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-32e578d5-d34f-4ef5-b708-34b2182fce61 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.765105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-32e578d5-d34f-4ef5-b708-34b2182fce61 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.904025 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-a838588b-4f1c-4af5-a489-02784d8c06c0 req-a19a6ccd-cd09-4939-9b1d-46a6e23d8102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2e447b-2106-40fb-b597-68d93b892257", "name": "network-vif-deleted", "tag": "20829f3b-879d-4eb3-8b68-490ae3b6e9e3"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:09.914773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-a838588b-4f1c-4af5-a489-02784d8c06c0 req-a19a6ccd-cd09-4939-9b1d-46a6e23d8102 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.915085 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-32e578d5-d34f-4ef5-b708-34b2182fce61 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:09.915806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-a838588b-4f1c-4af5-a489-02784d8c06c0 req-a19a6ccd-cd09-4939-9b1d-46a6e23d8102 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.916460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-a838588b-4f1c-4af5-a489-02784d8c06c0 req-a19a6ccd-cd09-4939-9b1d-46a6e23d8102 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.924679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-32e578d5-d34f-4ef5-b708-34b2182fce61 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1513 microversion: 2.1 time: 0.207946 Aug 24 10:18:09.926520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 85/174] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:09 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:09.928438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-a838588b-4f1c-4af5-a489-02784d8c06c0 req-a19a6ccd-cd09-4939-9b1d-46a6e23d8102 service nova] Creating event network-vif-deleted:20829f3b-879d-4eb3-8b68-490ae3b6e9e3 for instance 9d2e447b-2106-40fb-b597-68d93b892257 on hv-cinder-85427 Aug 24 10:18:09.935012 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-a838588b-4f1c-4af5-a489-02784d8c06c0 req-a19a6ccd-cd09-4939-9b1d-46a6e23d8102 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034301 Aug 24 10:18:09.936714 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 90/175] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:18:10.528158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-79982bef-73e1-4d7f-b9ee-885781b95068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:10.540332 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-79982bef-73e1-4d7f-b9ee-885781b95068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:10.540332 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-79982bef-73e1-4d7f-b9ee-885781b95068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.540332 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-79982bef-73e1-4d7f-b9ee-885781b95068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.540332 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-79982bef-73e1-4d7f-b9ee-885781b95068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.540778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-79982bef-73e1-4d7f-b9ee-885781b95068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.540778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-79982bef-73e1-4d7f-b9ee-885781b95068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.540778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-79982bef-73e1-4d7f-b9ee-885781b95068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.674885 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-79982bef-73e1-4d7f-b9ee-885781b95068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:10.684401 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-79982bef-73e1-4d7f-b9ee-885781b95068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.160116 Aug 24 10:18:10.685358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 86/176] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:10 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:10.950253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:10.950965 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:10.957239 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.957907 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.958892 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.959095 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.959559 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.959984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.996577 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.997014 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.997453 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.997899 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lazy-loading 'fault' on Instance uuid 9d2e447b-2106-40fb-b597-68d93b892257 {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:18:11.044555 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:11.052713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-156e165b-fea3-4966-9357-541f0c9cbe1b tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1351 microversion: 2.1 time: 0.108497 Aug 24 10:18:11.053314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 91/177] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:10 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:11.709185 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4f580f4f-abbe-41f6-a690-2d91639df283 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:11.709934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4f580f4f-abbe-41f6-a690-2d91639df283 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:11.718480 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f580f4f-abbe-41f6-a690-2d91639df283 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.721879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f580f4f-abbe-41f6-a690-2d91639df283 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.721879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f580f4f-abbe-41f6-a690-2d91639df283 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.721879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f580f4f-abbe-41f6-a690-2d91639df283 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.721879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f580f4f-abbe-41f6-a690-2d91639df283 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.722549 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f580f4f-abbe-41f6-a690-2d91639df283 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.971709 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4f580f4f-abbe-41f6-a690-2d91639df283 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:11.981882 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4f580f4f-abbe-41f6-a690-2d91639df283 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.276353 Aug 24 10:18:11.982617 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 87/178] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:11 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:12.080001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:12.080001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:12.084204 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:12.084687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:12.086165 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:12.086708 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:12.087164 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:12.087599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:12.127319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:12.127873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:12.128524 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:12.128890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lazy-loading 'fault' on Instance uuid 9d2e447b-2106-40fb-b597-68d93b892257 {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:18:12.176248 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:12.185779 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7c388067-3313-4a50-b872-f205ebde366d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1351 microversion: 2.1 time: 0.113965 Aug 24 10:18:12.188801 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 92/179] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:12 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:13.010961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-99f5b4f5-fe1a-492f-b2f7-fa1fbc03d343 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:13.010961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-99f5b4f5-fe1a-492f-b2f7-fa1fbc03d343 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:13.013515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-99f5b4f5-fe1a-492f-b2f7-fa1fbc03d343 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.013999 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-99f5b4f5-fe1a-492f-b2f7-fa1fbc03d343 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.014448 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-99f5b4f5-fe1a-492f-b2f7-fa1fbc03d343 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.015162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-99f5b4f5-fe1a-492f-b2f7-fa1fbc03d343 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.015611 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-99f5b4f5-fe1a-492f-b2f7-fa1fbc03d343 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.016034 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-99f5b4f5-fe1a-492f-b2f7-fa1fbc03d343 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.198050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-99f5b4f5-fe1a-492f-b2f7-fa1fbc03d343 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:13.206269 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-99f5b4f5-fe1a-492f-b2f7-fa1fbc03d343 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.203950 Aug 24 10:18:13.211350 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:13.212753 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:13.219686 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.220171 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.220602 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.221030 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 88/180] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:13 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:13.221330 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.221777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.222193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.259144 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.259620 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.260043 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.260477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lazy-loading 'fault' on Instance uuid 9d2e447b-2106-40fb-b597-68d93b892257 {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:18:13.309965 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:13.321676 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-73c1738e-cbac-4795-af42-3103a44c915d tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1351 microversion: 2.1 time: 0.115790 Aug 24 10:18:13.322792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 93/181] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:13 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:14.227826 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f7331556-44ec-4f60-9ff2-0f03e24e1d2a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:14.228427 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f7331556-44ec-4f60-9ff2-0f03e24e1d2a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:14.235047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f7331556-44ec-4f60-9ff2-0f03e24e1d2a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.235522 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f7331556-44ec-4f60-9ff2-0f03e24e1d2a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.235955 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f7331556-44ec-4f60-9ff2-0f03e24e1d2a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.236645 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f7331556-44ec-4f60-9ff2-0f03e24e1d2a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.237115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f7331556-44ec-4f60-9ff2-0f03e24e1d2a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.237538 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f7331556-44ec-4f60-9ff2-0f03e24e1d2a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.344225 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:14.344910 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:14.351101 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.351604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.352175 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.352975 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.353435 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.353864 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.388444 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f7331556-44ec-4f60-9ff2-0f03e24e1d2a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:14.396236 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.396645 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.397109 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.398291 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lazy-loading 'fault' on Instance uuid 9d2e447b-2106-40fb-b597-68d93b892257 {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:18:14.398800 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f7331556-44ec-4f60-9ff2-0f03e24e1d2a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.173880 Aug 24 10:18:14.407818 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 89/182] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:14 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:14.451913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '669c94a1591f41ae81d27f608987850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b0c27ad44c455eb42d6a21931d42f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:14.461349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-72f6ba13-6d6e-4704-bcf0-af7b21ca49c4 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 200 len: 1351 microversion: 2.1 time: 0.120935 Aug 24 10:18:14.470021 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 94/183] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:14 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 1351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:15.422455 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-fc1fe9fb-56fe-402a-9be1-1021a4d4d5e7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:15.423091 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-fc1fe9fb-56fe-402a-9be1-1021a4d4d5e7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:15.432014 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc1fe9fb-56fe-402a-9be1-1021a4d4d5e7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.432505 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc1fe9fb-56fe-402a-9be1-1021a4d4d5e7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.432972 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc1fe9fb-56fe-402a-9be1-1021a4d4d5e7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.433677 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc1fe9fb-56fe-402a-9be1-1021a4d4d5e7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.434183 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc1fe9fb-56fe-402a-9be1-1021a4d4d5e7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.434683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc1fe9fb-56fe-402a-9be1-1021a4d4d5e7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.481681 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:15.482320 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:15.488381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.489145 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.489838 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.490793 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.491243 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.491719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.506532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] HTTP exception thrown: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Request method failure captured: Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 HTTP/1.1 Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfql3_QbQvQV6dEWBpiRy-UBiRgzAd7ETd1kaowvUswGi_R1uyDl5ImKe0vpt7mBh3c9gdcu5FHk63CIlvshfgMNLHJRQeHnCOiQZNJsTyUYZCZ4aLnWV-ZjxgpQOcE9IkHvocO8N5Wu1-kGkkpuFRs5c6hCBLG-z8cTSfFHlcYDF2I Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: d4b0c27ad44c455eb42d6a21931d42f8 Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:18:15.512190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d4b0c27ad44c455eb42d6a21931d42f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: d4b0c27ad44c455eb42d6a21931d42f8 Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-DeleteServersTestJSON-143635167-project Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 669c94a1591f41ae81d27f608987850f Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-DeleteServersTestJSON-143635167-project Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:15.513859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '9d2e447b-2106-40fb-b597-68d93b892257'} Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:15.516189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:15.517984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:15.519142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Returning 404 to user: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:15.519142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e6e8063c-bc59-40e5-bcad-fb435466700e tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 404 len: 111 microversion: 2.1 time: 0.035978 Aug 24 10:18:15.519142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 95/184] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:15 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:15.602198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-fc1fe9fb-56fe-402a-9be1-1021a4d4d5e7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:15.611413 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-fc1fe9fb-56fe-402a-9be1-1021a4d4d5e7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.194023 Aug 24 10:18:15.615565 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 90/185] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:15 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:15.662775 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:15.665186 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:15.671409 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.671931 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.672387 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.673106 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.673551 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.674239 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.692327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] HTTP exception thrown: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Request method failure captured: Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257/os-volume_attachments HTTP/1.1 Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfql3_QbQvQV6dEWBpiRy-UBiRgzAd7ETd1kaowvUswGi_R1uyDl5ImKe0vpt7mBh3c9gdcu5FHk63CIlvshfgMNLHJRQeHnCOiQZNJsTyUYZCZ4aLnWV-ZjxgpQOcE9IkHvocO8N5Wu1-kGkkpuFRs5c6hCBLG-z8cTSfFHlcYDF2I Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: d4b0c27ad44c455eb42d6a21931d42f8 Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:18:15.695154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d4b0c27ad44c455eb42d6a21931d42f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: d4b0c27ad44c455eb42d6a21931d42f8 Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-DeleteServersTestJSON-143635167-project Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 669c94a1591f41ae81d27f608987850f Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-DeleteServersTestJSON-143635167-project Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:15.696530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'server_id': '9d2e447b-2106-40fb-b597-68d93b892257'} Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:15.701141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:15.702623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:15.703870 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Returning 404 to user: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:15.703870 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-160c14a6-a62f-4c42-bbe6-b1b53007ba21 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040136 Aug 24 10:18:15.703870 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 96/186] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:18:15 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:16.636021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-39e861d8-577a-4b9f-bcd8-90d2d2816627 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:16.636630 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-39e861d8-577a-4b9f-bcd8-90d2d2816627 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:16.643345 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e861d8-577a-4b9f-bcd8-90d2d2816627 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.643857 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e861d8-577a-4b9f-bcd8-90d2d2816627 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.644320 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e861d8-577a-4b9f-bcd8-90d2d2816627 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.645062 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e861d8-577a-4b9f-bcd8-90d2d2816627 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.645525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e861d8-577a-4b9f-bcd8-90d2d2816627 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.646303 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39e861d8-577a-4b9f-bcd8-90d2d2816627 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.790606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-39e861d8-577a-4b9f-bcd8-90d2d2816627 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:16.801043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-39e861d8-577a-4b9f-bcd8-90d2d2816627 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.169128 Aug 24 10:18:16.801636 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 91/187] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:16 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:17.148200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:17.149044 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:17.156708 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.156708 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.156708 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.157017 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.157229 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.157652 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.173073 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] HTTP exception thrown: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Request method failure captured: Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: DELETE /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 HTTP/1.1 Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfql3_QbQvQV6dEWBpiRy-UBiRgzAd7ETd1kaowvUswGi_R1uyDl5ImKe0vpt7mBh3c9gdcu5FHk63CIlvshfgMNLHJRQeHnCOiQZNJsTyUYZCZ4aLnWV-ZjxgpQOcE9IkHvocO8N5Wu1-kGkkpuFRs5c6hCBLG-z8cTSfFHlcYDF2I Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: d4b0c27ad44c455eb42d6a21931d42f8 Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:18:17.174619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d4b0c27ad44c455eb42d6a21931d42f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: d4b0c27ad44c455eb42d6a21931d42f8 Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-DeleteServersTestJSON-143635167-project Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 669c94a1591f41ae81d27f608987850f Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-DeleteServersTestJSON-143635167-project Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:17.176067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '9d2e447b-2106-40fb-b597-68d93b892257'} Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:17.176834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:17.177929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:18:17.179533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Returning 404 to user: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:17.179533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e949f1f0-a0cd-4a39-bb54-e492ad381ad8 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 404 len: 111 microversion: 2.1 time: 0.032071 Aug 24 10:18:17.179533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 97/188] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:18:17 2022] DELETE /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:17.185353 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:17.185899 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] [instance: 9d2e447b-2106-40fb-b597-68d93b892257] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:17.191832 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.192315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.192752 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.193475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.193925 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.201636 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.211171 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] HTTP exception thrown: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Request method failure captured: Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 HTTP/1.1 Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfql3_QbQvQV6dEWBpiRy-UBiRgzAd7ETd1kaowvUswGi_R1uyDl5ImKe0vpt7mBh3c9gdcu5FHk63CIlvshfgMNLHJRQeHnCOiQZNJsTyUYZCZ4aLnWV-ZjxgpQOcE9IkHvocO8N5Wu1-kGkkpuFRs5c6hCBLG-z8cTSfFHlcYDF2I Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: d4b0c27ad44c455eb42d6a21931d42f8 Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:18:17.216237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d4b0c27ad44c455eb42d6a21931d42f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d4b0c27ad44c455eb42d6a21931d42f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: d4b0c27ad44c455eb42d6a21931d42f8 Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-DeleteServersTestJSON-143635167 Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-DeleteServersTestJSON-143635167-project Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 669c94a1591f41ae81d27f608987850f Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-DeleteServersTestJSON-143635167-project Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:17.217898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '9d2e447b-2106-40fb-b597-68d93b892257'} Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:17.218628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. Aug 24 10:18:17.219889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:18:17.221137 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] Returning 404 to user: Instance 9d2e447b-2106-40fb-b597-68d93b892257 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:17.221137 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-196911da-9877-4bb4-9d5d-36cd6722c2b2 tempest-DeleteServersTestJSON-143635167 tempest-DeleteServersTestJSON-143635167-project] 10.222.0.30 "GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257" status: 404 len: 111 microversion: 2.1 time: 0.036290 Aug 24 10:18:17.221137 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 92/189] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:17 2022] GET /compute/v2.1/servers/9d2e447b-2106-40fb-b597-68d93b892257 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:18:17.823466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8c1c9d1e-fa74-4995-8a00-b1acc3b09514 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:17.824010 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8c1c9d1e-fa74-4995-8a00-b1acc3b09514 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:17.830183 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8c1c9d1e-fa74-4995-8a00-b1acc3b09514 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.830814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8c1c9d1e-fa74-4995-8a00-b1acc3b09514 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.831086 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8c1c9d1e-fa74-4995-8a00-b1acc3b09514 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.831798 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8c1c9d1e-fa74-4995-8a00-b1acc3b09514 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.832233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8c1c9d1e-fa74-4995-8a00-b1acc3b09514 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.832653 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8c1c9d1e-fa74-4995-8a00-b1acc3b09514 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.979135 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8c1c9d1e-fa74-4995-8a00-b1acc3b09514 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:17.988317 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8c1c9d1e-fa74-4995-8a00-b1acc3b09514 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.169672 Aug 24 10:18:17.995998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 98/190] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:17 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:19.015018 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5e7bd981-361c-4bd8-ab70-918d77a871b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:19.016083 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5e7bd981-361c-4bd8-ab70-918d77a871b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:19.022008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e7bd981-361c-4bd8-ab70-918d77a871b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.023122 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e7bd981-361c-4bd8-ab70-918d77a871b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.023895 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e7bd981-361c-4bd8-ab70-918d77a871b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.024637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e7bd981-361c-4bd8-ab70-918d77a871b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.025155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e7bd981-361c-4bd8-ab70-918d77a871b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.025557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5e7bd981-361c-4bd8-ab70-918d77a871b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.045373 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:19.293225 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5e7bd981-361c-4bd8-ab70-918d77a871b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:19.311059 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5e7bd981-361c-4bd8-ab70-918d77a871b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.299493 Aug 24 10:18:19.313615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 93/191] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:19 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:20.333120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a0ce162b-87ce-47fb-b45c-84394348cefb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:20.333720 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a0ce162b-87ce-47fb-b45c-84394348cefb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:20.340077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0ce162b-87ce-47fb-b45c-84394348cefb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:20.340552 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0ce162b-87ce-47fb-b45c-84394348cefb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:20.341010 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0ce162b-87ce-47fb-b45c-84394348cefb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:20.341696 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0ce162b-87ce-47fb-b45c-84394348cefb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:20.342142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0ce162b-87ce-47fb-b45c-84394348cefb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:20.342558 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0ce162b-87ce-47fb-b45c-84394348cefb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:20.496278 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a0ce162b-87ce-47fb-b45c-84394348cefb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:20.510170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a0ce162b-87ce-47fb-b45c-84394348cefb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.180796 Aug 24 10:18:20.510683 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 99/192] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:20 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:21.542142 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0311a0a2-3f91-4837-9724-01a115c105c3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:21.543073 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0311a0a2-3f91-4837-9724-01a115c105c3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:21.550182 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0311a0a2-3f91-4837-9724-01a115c105c3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.550737 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0311a0a2-3f91-4837-9724-01a115c105c3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.551272 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0311a0a2-3f91-4837-9724-01a115c105c3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.552027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0311a0a2-3f91-4837-9724-01a115c105c3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.552546 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0311a0a2-3f91-4837-9724-01a115c105c3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.553195 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0311a0a2-3f91-4837-9724-01a115c105c3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.700829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0311a0a2-3f91-4837-9724-01a115c105c3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:21.709416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0311a0a2-3f91-4837-9724-01a115c105c3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.171345 Aug 24 10:18:21.710139 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 94/193] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:21 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:22.731257 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-709583a9-9788-4602-8b6b-5c2e762eeff6 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:22.731872 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-709583a9-9788-4602-8b6b-5c2e762eeff6 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:22.738158 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-709583a9-9788-4602-8b6b-5c2e762eeff6 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:22.738635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-709583a9-9788-4602-8b6b-5c2e762eeff6 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:22.739058 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-709583a9-9788-4602-8b6b-5c2e762eeff6 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:22.740009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-709583a9-9788-4602-8b6b-5c2e762eeff6 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:22.740463 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-709583a9-9788-4602-8b6b-5c2e762eeff6 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:22.740923 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-709583a9-9788-4602-8b6b-5c2e762eeff6 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:22.915580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-709583a9-9788-4602-8b6b-5c2e762eeff6 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:22.926623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-709583a9-9788-4602-8b6b-5c2e762eeff6 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.199304 Aug 24 10:18:22.927348 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 100/194] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:22 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:23.959518 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7c7b371e-72cb-4028-b0f8-d3f22844c7ea tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:23.960415 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7c7b371e-72cb-4028-b0f8-d3f22844c7ea tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:23.967695 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7b371e-72cb-4028-b0f8-d3f22844c7ea tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.968175 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7b371e-72cb-4028-b0f8-d3f22844c7ea tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.968603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7b371e-72cb-4028-b0f8-d3f22844c7ea tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:23.969322 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7b371e-72cb-4028-b0f8-d3f22844c7ea tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.969769 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7b371e-72cb-4028-b0f8-d3f22844c7ea tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.970191 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7b371e-72cb-4028-b0f8-d3f22844c7ea tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:24.339375 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7c7b371e-72cb-4028-b0f8-d3f22844c7ea tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:24.347076 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7c7b371e-72cb-4028-b0f8-d3f22844c7ea tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.391373 Aug 24 10:18:24.347648 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 95/195] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:23 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:25.370416 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-353137c3-4d7b-48e0-a0a2-429967359940 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:25.371198 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-353137c3-4d7b-48e0-a0a2-429967359940 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:25.374814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:25.378163 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-353137c3-4d7b-48e0-a0a2-429967359940 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:25.378802 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-353137c3-4d7b-48e0-a0a2-429967359940 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:25.379370 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-353137c3-4d7b-48e0-a0a2-429967359940 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:25.380250 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-353137c3-4d7b-48e0-a0a2-429967359940 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:25.380890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-353137c3-4d7b-48e0-a0a2-429967359940 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:25.381445 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-353137c3-4d7b-48e0-a0a2-429967359940 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:25.387236 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:25.531652 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-353137c3-4d7b-48e0-a0a2-429967359940 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:25.539404 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-353137c3-4d7b-48e0-a0a2-429967359940 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.173907 Aug 24 10:18:25.540023 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 101/196] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:25 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:26.560843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c8c85c54-a9e4-43ee-9509-a496d1198751 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:26.561645 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c8c85c54-a9e4-43ee-9509-a496d1198751 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:26.565095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=42 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:26.570985 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8c85c54-a9e4-43ee-9509-a496d1198751 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.571327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8c85c54-a9e4-43ee-9509-a496d1198751 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.571773 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8c85c54-a9e4-43ee-9509-a496d1198751 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.572577 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8c85c54-a9e4-43ee-9509-a496d1198751 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.573098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8c85c54-a9e4-43ee-9509-a496d1198751 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.573525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8c85c54-a9e4-43ee-9509-a496d1198751 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.806053 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c8c85c54-a9e4-43ee-9509-a496d1198751 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:26.815208 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c8c85c54-a9e4-43ee-9509-a496d1198751 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.258288 Aug 24 10:18:26.818346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 96/197] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:26 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:27.839031 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2d7e2b81-833b-4787-b39a-9f1f1c145a43 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:27.839675 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2d7e2b81-833b-4787-b39a-9f1f1c145a43 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:27.846959 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d7e2b81-833b-4787-b39a-9f1f1c145a43 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.847442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d7e2b81-833b-4787-b39a-9f1f1c145a43 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.847871 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d7e2b81-833b-4787-b39a-9f1f1c145a43 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.848557 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d7e2b81-833b-4787-b39a-9f1f1c145a43 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.849104 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d7e2b81-833b-4787-b39a-9f1f1c145a43 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.849458 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d7e2b81-833b-4787-b39a-9f1f1c145a43 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:28.000362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2d7e2b81-833b-4787-b39a-9f1f1c145a43 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:28.012131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2d7e2b81-833b-4787-b39a-9f1f1c145a43 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.178309 Aug 24 10:18:28.012718 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 102/198] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:27 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:29.044343 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-589191f7-9489-4120-9479-700e47b240c1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:29.045704 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-589191f7-9489-4120-9479-700e47b240c1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:29.063097 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-589191f7-9489-4120-9479-700e47b240c1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:29.064039 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-589191f7-9489-4120-9479-700e47b240c1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:29.065019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-589191f7-9489-4120-9479-700e47b240c1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:29.066028 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-589191f7-9489-4120-9479-700e47b240c1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:29.067786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-589191f7-9489-4120-9479-700e47b240c1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:29.068439 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-589191f7-9489-4120-9479-700e47b240c1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:29.262399 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-589191f7-9489-4120-9479-700e47b240c1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:29.271195 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-589191f7-9489-4120-9479-700e47b240c1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1522 microversion: 2.1 time: 0.232425 Aug 24 10:18:29.271805 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 97/199] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:29 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:30.293807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-abeb31e1-c116-40ec-935a-62f89987c812 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:30.294570 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-abeb31e1-c116-40ec-935a-62f89987c812 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:30.301541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abeb31e1-c116-40ec-935a-62f89987c812 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.303417 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abeb31e1-c116-40ec-935a-62f89987c812 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.303417 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abeb31e1-c116-40ec-935a-62f89987c812 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.303417 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abeb31e1-c116-40ec-935a-62f89987c812 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.304514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abeb31e1-c116-40ec-935a-62f89987c812 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.304965 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abeb31e1-c116-40ec-935a-62f89987c812 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.436026 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7a2af650-8411-4683-a262-fae878078958 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Action: 'create', calling method: .version_select at 0x7f0af45c1c10>, body: {"keypair": {"name": "tempest-keypair-2089256025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQhHKlSQga8wAGDk9W+2zdF4/fa+JrlxMDpOevisaVXETu2KwoFgdE4NY4Go4gqFtn+QorZG8O6aB4C7j7JlpmQCBcmgFVMG2K0uXP2Q/GpSDLVW6NUVE6hoTkSm/4qsw=="}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:30.459428 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-7a2af650-8411-4683-a262-fae878078958 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Getting quotas for project dad90b6c7dd947dda6faa1fc1feb6d7b. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:18:30.464219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-7a2af650-8411-4683-a262-fae878078958 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Getting quotas for user 8d72e2cc5b804b0bb556599a26d923ac and project dad90b6c7dd947dda6faa1fc1feb6d7b. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:18:30.469745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-abeb31e1-c116-40ec-935a-62f89987c812 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:30.484525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-abeb31e1-c116-40ec-935a-62f89987c812 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1502 microversion: 2.1 time: 0.194518 Aug 24 10:18:30.485235 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 98/200] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:30 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:30.506255 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e18cfd2d-fed2-4839-9bb4-6b67293cfcdf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:30.507257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-e18cfd2d-fed2-4839-9bb4-6b67293cfcdf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:30.513466 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e18cfd2d-fed2-4839-9bb4-6b67293cfcdf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.513952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e18cfd2d-fed2-4839-9bb4-6b67293cfcdf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.514390 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e18cfd2d-fed2-4839-9bb4-6b67293cfcdf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.515112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e18cfd2d-fed2-4839-9bb4-6b67293cfcdf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:30.515579 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e18cfd2d-fed2-4839-9bb4-6b67293cfcdf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:30.516328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e18cfd2d-fed2-4839-9bb4-6b67293cfcdf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:30.567998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7a2af650-8411-4683-a262-fae878078958 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.298524 Aug 24 10:18:30.569389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 103/201] 10.222.0.30 () {62 vars in 1200 bytes} [Wed Aug 24 10:18:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 300 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 10:18:30.669916 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e18cfd2d-fed2-4839-9bb4-6b67293cfcdf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:30.680426 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e18cfd2d-fed2-4839-9bb4-6b67293cfcdf tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1517 microversion: 2.1 time: 0.178014 Aug 24 10:18:30.681033 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 99/202] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:30 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:32.662320 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-87b4bc62-1254-46c1-af89-95f73d7ee1b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:32.665601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-87b4bc62-1254-46c1-af89-95f73d7ee1b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:32.675650 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b4bc62-1254-46c1-af89-95f73d7ee1b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.676244 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b4bc62-1254-46c1-af89-95f73d7ee1b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.677004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b4bc62-1254-46c1-af89-95f73d7ee1b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.677761 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b4bc62-1254-46c1-af89-95f73d7ee1b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:32.678347 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b4bc62-1254-46c1-af89-95f73d7ee1b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:32.678889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87b4bc62-1254-46c1-af89-95f73d7ee1b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:32.705926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-87b4bc62-1254-46c1-af89-95f73d7ee1b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lazy-loading 'flavor' on Instance uuid 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:18:33.143747 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-87b4bc62-1254-46c1-af89-95f73d7ee1b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634/action" status: 200 len: 32 microversion: 2.1 time: 0.486510 Aug 24 10:18:33.146230 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 104/203] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:18:32 2022] POST /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634/action => generated 32 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:18:33.156308 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-657818ae-4a9e-44a5-adcb-52cc15033575 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:33.157518 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-657818ae-4a9e-44a5-adcb-52cc15033575 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:33.174119 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-657818ae-4a9e-44a5-adcb-52cc15033575 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.174993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-657818ae-4a9e-44a5-adcb-52cc15033575 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.175592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-657818ae-4a9e-44a5-adcb-52cc15033575 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.176625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-657818ae-4a9e-44a5-adcb-52cc15033575 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:33.177127 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-657818ae-4a9e-44a5-adcb-52cc15033575 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:33.177553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-657818ae-4a9e-44a5-adcb-52cc15033575 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:33.354408 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-657818ae-4a9e-44a5-adcb-52cc15033575 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:33.363133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-657818ae-4a9e-44a5-adcb-52cc15033575 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.210851 Aug 24 10:18:33.363724 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 100/204] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:33 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:33.528885 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-196125108", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "721eb6da-ac9c-4e0f-a47b-98c8e8d18efa"}], "security_groups": [{"name": "tempest-securitygroup--1535006490"}], "key_name": "tempest-keypair-2089256025", "user_data": "}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:33.715522 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.network.neutron [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] validate_networks() for [('721eb6da-ac9c-4e0f-a47b-98c8e8d18efa', None, None, None, None, None)] {{(pid=121271) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:18:34.386862 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d84d3700-62b0-4935-a823-39af093e260f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.387480 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d84d3700-62b0-4935-a823-39af093e260f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.394464 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d84d3700-62b0-4935-a823-39af093e260f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.394946 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d84d3700-62b0-4935-a823-39af093e260f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.395432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d84d3700-62b0-4935-a823-39af093e260f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.396410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d84d3700-62b0-4935-a823-39af093e260f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.396880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d84d3700-62b0-4935-a823-39af093e260f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.398445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d84d3700-62b0-4935-a823-39af093e260f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.614974 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Flavor limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:18:34.616259 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Image limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:18:34.617029 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Flavor pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:18:34.617616 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Image pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:18:34.627026 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:18:34.627264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d84d3700-62b0-4935-a823-39af093e260f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.627264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d84d3700-62b0-4935-a823-39af093e260f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.243838 Aug 24 10:18:34.627264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 101/205] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:34 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:34.628413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.628918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.637977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.638791 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:34.639281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:34.639712 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:34.659115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Getting quotas for project dad90b6c7dd947dda6faa1fc1feb6d7b. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:18:34.664039 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Getting quotas for user 8d72e2cc5b804b0bb556599a26d923ac and project dad90b6c7dd947dda6faa1fc1feb6d7b. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:18:34.677230 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Going to run 1 instances... {{(pid=121271) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:18:34.681506 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:18:34.896712 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-acfea963-1703-48d7-bcc3-aac668dec09b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.373985 Aug 24 10:18:34.904096 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 105/206] 10.222.0.30 () {62 vars in 1188 bytes} [Wed Aug 24 10:18:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:18:34.909385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4a57b664-4467-43f5-a1e6-4d0911f20da7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:34.910231 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4a57b664-4467-43f5-a1e6-4d0911f20da7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:34.981522 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4a57b664-4467-43f5-a1e6-4d0911f20da7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.990130 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4a57b664-4467-43f5-a1e6-4d0911f20da7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.991686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4a57b664-4467-43f5-a1e6-4d0911f20da7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:34.993101 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4a57b664-4467-43f5-a1e6-4d0911f20da7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1281 microversion: 2.20 time: 0.087655 Aug 24 10:18:35.009015 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 102/207] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:34 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:18:35.649646 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7c0662f7-de8f-4880-8f1d-be68f6901f82 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:35.650264 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7c0662f7-de8f-4880-8f1d-be68f6901f82 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:35.656525 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c0662f7-de8f-4880-8f1d-be68f6901f82 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.656979 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c0662f7-de8f-4880-8f1d-be68f6901f82 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.657420 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c0662f7-de8f-4880-8f1d-be68f6901f82 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.658116 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c0662f7-de8f-4880-8f1d-be68f6901f82 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:35.658570 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c0662f7-de8f-4880-8f1d-be68f6901f82 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:35.658998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7c0662f7-de8f-4880-8f1d-be68f6901f82 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:35.814794 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7c0662f7-de8f-4880-8f1d-be68f6901f82 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:35.823749 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7c0662f7-de8f-4880-8f1d-be68f6901f82 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.178880 Aug 24 10:18:35.824325 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 106/208] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:35 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:36.019443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d6ee48f4-0860-480a-9063-6bfe308d595c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:36.020125 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d6ee48f4-0860-480a-9063-6bfe308d595c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:36.074240 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d6ee48f4-0860-480a-9063-6bfe308d595c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.081839 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d6ee48f4-0860-480a-9063-6bfe308d595c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.083400 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d6ee48f4-0860-480a-9063-6bfe308d595c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:36.084617 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d6ee48f4-0860-480a-9063-6bfe308d595c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1281 microversion: 2.20 time: 0.069988 Aug 24 10:18:36.085318 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 103/209] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:36 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:36.846606 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-cf48c16f-453d-48a1-996c-40724d271bfe tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:36.847944 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-cf48c16f-453d-48a1-996c-40724d271bfe tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:36.860457 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cf48c16f-453d-48a1-996c-40724d271bfe tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.860457 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cf48c16f-453d-48a1-996c-40724d271bfe tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.860457 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cf48c16f-453d-48a1-996c-40724d271bfe tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:36.860457 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cf48c16f-453d-48a1-996c-40724d271bfe tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:36.861074 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cf48c16f-453d-48a1-996c-40724d271bfe tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:36.861074 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cf48c16f-453d-48a1-996c-40724d271bfe tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:37.017508 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-cf48c16f-453d-48a1-996c-40724d271bfe tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:37.026150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-cf48c16f-453d-48a1-996c-40724d271bfe tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.183700 Aug 24 10:18:37.026814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 107/210] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:36 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:37.107068 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:37.108481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:37.114994 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:37.115463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:37.115966 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:37.116646 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:37.117145 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:37.117606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:37.182959 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:37.191206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:37.192707 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:37.194545 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d40c966f-3ebc-4c2d-bb64-c09b38cf507e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1277 microversion: 2.20 time: 0.090694 Aug 24 10:18:37.195136 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 104/211] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:37 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:38.047773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-297b28e2-d5cb-4d17-acf6-b524f104216c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:38.048346 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-297b28e2-d5cb-4d17-acf6-b524f104216c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:38.054348 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-297b28e2-d5cb-4d17-acf6-b524f104216c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.054826 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-297b28e2-d5cb-4d17-acf6-b524f104216c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.055251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-297b28e2-d5cb-4d17-acf6-b524f104216c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.055930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-297b28e2-d5cb-4d17-acf6-b524f104216c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.056371 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-297b28e2-d5cb-4d17-acf6-b524f104216c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.056786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-297b28e2-d5cb-4d17-acf6-b524f104216c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.198579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-297b28e2-d5cb-4d17-acf6-b524f104216c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:38.206339 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-297b28e2-d5cb-4d17-acf6-b524f104216c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.162553 Aug 24 10:18:38.206911 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 108/212] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:38 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:38.216696 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:38.217348 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:38.223707 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.224186 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.224620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.225338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:38.225791 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:38.226840 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:38.290078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:38.298677 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:38.300178 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:38.301544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2af04df8-54b2-4d7d-9286-fdfab229417a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1341 microversion: 2.20 time: 0.088552 Aug 24 10:18:38.302099 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 105/213] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:38 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1341 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:39.227599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bea2dfb3-4161-4588-8137-b9ccd9631b0a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:39.228812 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bea2dfb3-4161-4588-8137-b9ccd9631b0a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:39.234584 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bea2dfb3-4161-4588-8137-b9ccd9631b0a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.235057 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bea2dfb3-4161-4588-8137-b9ccd9631b0a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.235484 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bea2dfb3-4161-4588-8137-b9ccd9631b0a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.236173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bea2dfb3-4161-4588-8137-b9ccd9631b0a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.236607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bea2dfb3-4161-4588-8137-b9ccd9631b0a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.237051 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bea2dfb3-4161-4588-8137-b9ccd9631b0a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.324072 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:39.324675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:39.331194 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.331785 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.332301 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.332930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:39.333740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:39.334228 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:39.385719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-bea2dfb3-4161-4588-8137-b9ccd9631b0a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:39.393586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bea2dfb3-4161-4588-8137-b9ccd9631b0a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.169918 Aug 24 10:18:39.394236 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 109/214] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:39 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:39.397103 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:39.406372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:39.407880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:39.409010 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-321d076f-8392-40d3-b497-7fcf1b1a7f6e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1341 microversion: 2.20 time: 0.089437 Aug 24 10:18:39.409568 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 106/215] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:39 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1341 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:40.416011 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9a6cc26c-c86f-4acf-a74a-6f34796e122d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.416653 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9a6cc26c-c86f-4acf-a74a-6f34796e122d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:40.422651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9a6cc26c-c86f-4acf-a74a-6f34796e122d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.423126 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9a6cc26c-c86f-4acf-a74a-6f34796e122d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.423554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9a6cc26c-c86f-4acf-a74a-6f34796e122d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.424238 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9a6cc26c-c86f-4acf-a74a-6f34796e122d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.424708 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9a6cc26c-c86f-4acf-a74a-6f34796e122d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.425133 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9a6cc26c-c86f-4acf-a74a-6f34796e122d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.432187 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:40.432803 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:40.439291 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.439772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.440210 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.440930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:40.441389 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:40.441815 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:40.505348 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.514572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.516070 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.517205 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7772b327-f68b-4216-90f5-d2f7129782bc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1341 microversion: 2.20 time: 0.089739 Aug 24 10:18:40.517766 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 107/216] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:40 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1341 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:18:40.556245 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9a6cc26c-c86f-4acf-a74a-6f34796e122d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:40.563934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9a6cc26c-c86f-4acf-a74a-6f34796e122d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.152045 Aug 24 10:18:40.564500 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 110/217] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:40 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:41.540033 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.540995 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.547504 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.547975 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.548402 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.549129 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.549581 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.550000 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.585505 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c79c1f8c-de16-4814-97a6-3b5545610942 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:41.587837 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c79c1f8c-de16-4814-97a6-3b5545610942 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:41.600178 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c79c1f8c-de16-4814-97a6-3b5545610942 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.600666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c79c1f8c-de16-4814-97a6-3b5545610942 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.601158 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c79c1f8c-de16-4814-97a6-3b5545610942 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.601859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c79c1f8c-de16-4814-97a6-3b5545610942 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:41.602343 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c79c1f8c-de16-4814-97a6-3b5545610942 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:41.603018 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c79c1f8c-de16-4814-97a6-3b5545610942 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:41.621916 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.630057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.631562 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.632667 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ab346ecf-eb7a-4b2a-ba46-7bf649ace087 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1351 microversion: 2.20 time: 0.096574 Aug 24 10:18:41.635211 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 108/218] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:41 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:41.846363 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c79c1f8c-de16-4814-97a6-3b5545610942 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:41.857389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c79c1f8c-de16-4814-97a6-3b5545610942 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.273982 Aug 24 10:18:41.870064 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 111/219] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:41 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:42.658799 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:42.659517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:42.666049 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.667330 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.667893 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.668612 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.669090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.669510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.820753 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:42.831027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:42.833024 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:42.833780 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-939054e0-e674-4f02-873f-45ed343c5cb4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.178938 Aug 24 10:18:42.834339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 109/220] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:42 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:42.881898 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-025da621-6956-4425-9c99-9ce1ae2c5eb7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:42.882502 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-025da621-6956-4425-9c99-9ce1ae2c5eb7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:42.889282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-025da621-6956-4425-9c99-9ce1ae2c5eb7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.889810 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-025da621-6956-4425-9c99-9ce1ae2c5eb7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.890407 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-025da621-6956-4425-9c99-9ce1ae2c5eb7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:42.890952 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-025da621-6956-4425-9c99-9ce1ae2c5eb7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:42.891395 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-025da621-6956-4425-9c99-9ce1ae2c5eb7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:42.891809 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-025da621-6956-4425-9c99-9ce1ae2c5eb7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.116208 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-025da621-6956-4425-9c99-9ce1ae2c5eb7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:43.124676 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-025da621-6956-4425-9c99-9ce1ae2c5eb7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.246801 Aug 24 10:18:43.125204 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 112/221] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:42 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:43.318584 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-b5d70444-a188-4c0b-b900-22d09347ff15 req-756fac1d-b12c-4876-8ea0-2d919d78e133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac36f3b6-c66c-406b-b472-0a2dd018d4c3", "tag": "9fdb04de-4902-4316-8683-e37dc854e2b3"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:43.349839 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-b5d70444-a188-4c0b-b900-22d09347ff15 req-756fac1d-b12c-4876-8ea0-2d919d78e133 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.350578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-b5d70444-a188-4c0b-b900-22d09347ff15 req-756fac1d-b12c-4876-8ea0-2d919d78e133 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.351227 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-b5d70444-a188-4c0b-b900-22d09347ff15 req-756fac1d-b12c-4876-8ea0-2d919d78e133 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.364877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-b5d70444-a188-4c0b-b900-22d09347ff15 req-756fac1d-b12c-4876-8ea0-2d919d78e133 service nova] Creating event network-changed:9fdb04de-4902-4316-8683-e37dc854e2b3 for instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 on hv-cinder-85427 Aug 24 10:18:43.370856 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-b5d70444-a188-4c0b-b900-22d09347ff15 req-756fac1d-b12c-4876-8ea0-2d919d78e133 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056673 Aug 24 10:18:43.371629 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 110/222] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:43.862313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:43.862313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:43.866051 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.866530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.866958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:43.867649 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:43.868150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:43.868504 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.065395 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:44.074693 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:44.076511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:44.077733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-fc56b89f-9151-46ef-a24b-30669e1c51fa tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.224177 Aug 24 10:18:44.078919 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 113/223] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:43 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:44.148290 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-742f5414-5742-469b-9a1a-8ec0bd074204 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:44.148809 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-742f5414-5742-469b-9a1a-8ec0bd074204 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:44.156234 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-742f5414-5742-469b-9a1a-8ec0bd074204 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.156806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-742f5414-5742-469b-9a1a-8ec0bd074204 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.157344 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-742f5414-5742-469b-9a1a-8ec0bd074204 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.158417 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-742f5414-5742-469b-9a1a-8ec0bd074204 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:44.158934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-742f5414-5742-469b-9a1a-8ec0bd074204 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:44.159416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-742f5414-5742-469b-9a1a-8ec0bd074204 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:44.326268 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-742f5414-5742-469b-9a1a-8ec0bd074204 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:44.335249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-742f5414-5742-469b-9a1a-8ec0bd074204 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.192192 Aug 24 10:18:44.336157 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 111/224] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:44 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:45.101914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:45.102540 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:45.105360 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:45.106116 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=10 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:45.111028 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.111580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.112066 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:45.112752 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.113288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.113711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:45.253126 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:45.262810 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:45.264314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:45.265466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-6f7f6861-ad11-4105-b44c-c0dee32a07ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.167825 Aug 24 10:18:45.266029 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 114/225] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:45 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:45.359575 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-068aba6a-d75c-432a-a9bd-b3e57c1aa59c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:45.360191 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-068aba6a-d75c-432a-a9bd-b3e57c1aa59c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:45.366978 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-068aba6a-d75c-432a-a9bd-b3e57c1aa59c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.367466 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-068aba6a-d75c-432a-a9bd-b3e57c1aa59c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.367906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-068aba6a-d75c-432a-a9bd-b3e57c1aa59c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:45.368599 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-068aba6a-d75c-432a-a9bd-b3e57c1aa59c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:45.369151 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-068aba6a-d75c-432a-a9bd-b3e57c1aa59c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:45.369581 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-068aba6a-d75c-432a-a9bd-b3e57c1aa59c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:45.508072 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-068aba6a-d75c-432a-a9bd-b3e57c1aa59c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:45.511994 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:45.516716 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-068aba6a-d75c-432a-a9bd-b3e57c1aa59c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.161012 Aug 24 10:18:45.517327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 112/226] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:45 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:46.287741 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:46.288353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:46.295442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.295935 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.296368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.297101 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.297555 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.297981 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.436657 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:46.447854 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:46.450438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:46.452212 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ea976722-ca12-4dcf-8560-c5e2db594748 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.168254 Aug 24 10:18:46.453364 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 115/227] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:46 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:46.539648 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-393cd6ea-9329-4952-97a1-42ee1c9a19c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:46.541538 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-393cd6ea-9329-4952-97a1-42ee1c9a19c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:46.549780 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=4 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:46.553221 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-393cd6ea-9329-4952-97a1-42ee1c9a19c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.554287 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-393cd6ea-9329-4952-97a1-42ee1c9a19c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.554825 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-393cd6ea-9329-4952-97a1-42ee1c9a19c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.555957 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-393cd6ea-9329-4952-97a1-42ee1c9a19c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:46.556514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-393cd6ea-9329-4952-97a1-42ee1c9a19c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:46.557202 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-393cd6ea-9329-4952-97a1-42ee1c9a19c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:46.697259 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-393cd6ea-9329-4952-97a1-42ee1c9a19c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:46.706144 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-393cd6ea-9329-4952-97a1-42ee1c9a19c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.171063 Aug 24 10:18:46.706729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 113/228] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:46 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:47.476024 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:47.477265 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:47.484277 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.484755 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.485216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.485913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.486363 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.486785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.671778 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:47.680053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:47.681593 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:47.683347 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-98729c3b-2a9f-46fa-acec-094498d204c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.211317 Aug 24 10:18:47.683916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 116/229] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:47 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:47.727586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2ef976bb-e7db-4ce3-a135-6b72762f611f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:47.728198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2ef976bb-e7db-4ce3-a135-6b72762f611f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:47.735879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ef976bb-e7db-4ce3-a135-6b72762f611f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.736387 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ef976bb-e7db-4ce3-a135-6b72762f611f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.736817 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ef976bb-e7db-4ce3-a135-6b72762f611f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.737722 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ef976bb-e7db-4ce3-a135-6b72762f611f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:47.738170 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ef976bb-e7db-4ce3-a135-6b72762f611f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:47.738591 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ef976bb-e7db-4ce3-a135-6b72762f611f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:47.885250 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2ef976bb-e7db-4ce3-a135-6b72762f611f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:47.894321 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2ef976bb-e7db-4ce3-a135-6b72762f611f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.170421 Aug 24 10:18:47.895086 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 114/230] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:47 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:48.679051 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-4ba2b216-d76e-4015-8b1e-9f87738d0653 req-f7e4b632-a3b2-4f5f-8700-8e19b8b66190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac36f3b6-c66c-406b-b472-0a2dd018d4c3", "name": "network-vif-plugged", "status": "completed", "tag": "9fdb04de-4902-4316-8683-e37dc854e2b3"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:48.689729 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-4ba2b216-d76e-4015-8b1e-9f87738d0653 req-f7e4b632-a3b2-4f5f-8700-8e19b8b66190 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.690400 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-4ba2b216-d76e-4015-8b1e-9f87738d0653 req-f7e4b632-a3b2-4f5f-8700-8e19b8b66190 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.690996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-4ba2b216-d76e-4015-8b1e-9f87738d0653 req-f7e4b632-a3b2-4f5f-8700-8e19b8b66190 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.705753 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-4ba2b216-d76e-4015-8b1e-9f87738d0653 req-f7e4b632-a3b2-4f5f-8700-8e19b8b66190 service nova] Creating event network-vif-plugged:9fdb04de-4902-4316-8683-e37dc854e2b3 for instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 on hv-cinder-85427 Aug 24 10:18:48.708080 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:48.708696 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:48.712198 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-4ba2b216-d76e-4015-8b1e-9f87738d0653 req-f7e4b632-a3b2-4f5f-8700-8e19b8b66190 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036480 Aug 24 10:18:48.713358 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 117/231] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:48.715973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.720148 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.720606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.722512 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.722833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.723424 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.864028 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:48.872398 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:48.874029 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:48.875141 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f4823c7b-21e6-40bb-90be-a0c8d98bcfb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.171874 Aug 24 10:18:48.875672 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 115/232] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:48 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:18:48.927799 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3aba6a82-7e3f-4b8c-9926-91aeb6d86c3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:48.929821 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3aba6a82-7e3f-4b8c-9926-91aeb6d86c3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:48.944838 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3aba6a82-7e3f-4b8c-9926-91aeb6d86c3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.946458 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3aba6a82-7e3f-4b8c-9926-91aeb6d86c3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.947589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3aba6a82-7e3f-4b8c-9926-91aeb6d86c3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.949281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3aba6a82-7e3f-4b8c-9926-91aeb6d86c3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:48.950441 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3aba6a82-7e3f-4b8c-9926-91aeb6d86c3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:48.951230 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3aba6a82-7e3f-4b8c-9926-91aeb6d86c3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:48.960820 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:49.255684 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3aba6a82-7e3f-4b8c-9926-91aeb6d86c3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:49.266862 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3aba6a82-7e3f-4b8c-9926-91aeb6d86c3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.353671 Aug 24 10:18:49.274150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 118/233] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:48 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:49.914409 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:49.915647 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:49.923446 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:49.924221 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:49.931726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:49.931726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:49.931726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:49.931726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.065602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:50.073894 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:50.075389 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:50.076493 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1338e8fa-fac0-4188-a6fd-047f053e310b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.165950 Aug 24 10:18:50.077084 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 116/234] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:49 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:50.083162 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-71ef7a38-7a0f-4f23-ab6b-94f9d794c71d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:50.083631 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-71ef7a38-7a0f-4f23-ab6b-94f9d794c71d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:50.090495 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71ef7a38-7a0f-4f23-ab6b-94f9d794c71d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:50.090904 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71ef7a38-7a0f-4f23-ab6b-94f9d794c71d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:50.091332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71ef7a38-7a0f-4f23-ab6b-94f9d794c71d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.092011 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71ef7a38-7a0f-4f23-ab6b-94f9d794c71d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:50.092457 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71ef7a38-7a0f-4f23-ab6b-94f9d794c71d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:50.092886 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-71ef7a38-7a0f-4f23-ab6b-94f9d794c71d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.115959 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-71ef7a38-7a0f-4f23-ab6b-94f9d794c71d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/ips" status: 200 len: 149 microversion: 2.1 time: 0.036922 Aug 24 10:18:50.116521 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 119/235] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Aug 24 10:18:50 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:50.290809 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-00253f35-ff9d-45f4-b639-2074c19acca7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:50.291640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-00253f35-ff9d-45f4-b639-2074c19acca7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:50.298716 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00253f35-ff9d-45f4-b639-2074c19acca7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:50.299375 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00253f35-ff9d-45f4-b639-2074c19acca7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:50.299812 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00253f35-ff9d-45f4-b639-2074c19acca7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.300512 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00253f35-ff9d-45f4-b639-2074c19acca7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:50.301007 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00253f35-ff9d-45f4-b639-2074c19acca7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:50.301438 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00253f35-ff9d-45f4-b639-2074c19acca7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:50.459077 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-00253f35-ff9d-45f4-b639-2074c19acca7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:50.467542 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-00253f35-ff9d-45f4-b639-2074c19acca7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.180467 Aug 24 10:18:50.468403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 117/236] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:50 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:51.104727 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:51.104727 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:51.110380 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.110883 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.111410 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.112140 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.113104 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.113342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.314597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:51.322777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:51.324840 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:51.326150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d23e530b-b78e-4eb6-b224-89c252402dc8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1407 microversion: 2.20 time: 0.228494 Aug 24 10:18:51.331223 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 120/237] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:51 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:18:51.489741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0e315bcb-8fcb-461e-a87e-99866ff4d172 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:51.490369 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0e315bcb-8fcb-461e-a87e-99866ff4d172 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:51.490934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ee346202-72f7-4651-aa6c-df32a547a274 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:51.491535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ee346202-72f7-4651-aa6c-df32a547a274 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:51.498082 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e315bcb-8fcb-461e-a87e-99866ff4d172 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.498386 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee346202-72f7-4651-aa6c-df32a547a274 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.503024 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e315bcb-8fcb-461e-a87e-99866ff4d172 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.503153 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee346202-72f7-4651-aa6c-df32a547a274 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.503245 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e315bcb-8fcb-461e-a87e-99866ff4d172 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.503341 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee346202-72f7-4651-aa6c-df32a547a274 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.503442 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e315bcb-8fcb-461e-a87e-99866ff4d172 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.503529 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee346202-72f7-4651-aa6c-df32a547a274 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.503611 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e315bcb-8fcb-461e-a87e-99866ff4d172 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.503611 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e315bcb-8fcb-461e-a87e-99866ff4d172 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.503768 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee346202-72f7-4651-aa6c-df32a547a274 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.503768 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ee346202-72f7-4651-aa6c-df32a547a274 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.526455 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ee346202-72f7-4651-aa6c-df32a547a274 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/ips" status: 200 len: 145 microversion: 2.1 time: 0.039613 Aug 24 10:18:51.532476 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 121/238] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Aug 24 10:18:51 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:18:51.703591 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0e315bcb-8fcb-461e-a87e-99866ff4d172 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:51.711292 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0e315bcb-8fcb-461e-a87e-99866ff4d172 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.225620 Aug 24 10:18:51.711860 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 118/239] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:51 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:51.855615 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0112e8e5-56e2-4113-b991-d8bdb7909733 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21510d79-4d00-4c17-84c5-8a2fb5e443cc"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:51.858032 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0112e8e5-56e2-4113-b991-d8bdb7909733 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:51.863810 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0112e8e5-56e2-4113-b991-d8bdb7909733 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.864284 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0112e8e5-56e2-4113-b991-d8bdb7909733 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.865020 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0112e8e5-56e2-4113-b991-d8bdb7909733 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:51.865707 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0112e8e5-56e2-4113-b991-d8bdb7909733 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:51.866260 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0112e8e5-56e2-4113-b991-d8bdb7909733 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:51.866674 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0112e8e5-56e2-4113-b991-d8bdb7909733 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.349201 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:52.350083 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:52.357612 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.358328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.358923 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.359786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.360392 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.361004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.523066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:52.536165 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:52.537711 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:52.538874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-68656aa8-fa89-4b6c-a489-6970169a4d6a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1599 microversion: 2.20 time: 0.193784 Aug 24 10:18:52.539517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 119/240] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:18:52 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1599 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:18:52.570279 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2e46916c-02b1-48c8-9c38-a053ef09c3fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:52.570775 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2e46916c-02b1-48c8-9c38-a053ef09c3fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:52.578083 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2e46916c-02b1-48c8-9c38-a053ef09c3fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.578565 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2e46916c-02b1-48c8-9c38-a053ef09c3fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.579289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2e46916c-02b1-48c8-9c38-a053ef09c3fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.580165 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2e46916c-02b1-48c8-9c38-a053ef09c3fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.580962 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2e46916c-02b1-48c8-9c38-a053ef09c3fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.583189 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2e46916c-02b1-48c8-9c38-a053ef09c3fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.669950 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2e46916c-02b1-48c8-9c38-a053ef09c3fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103849 Aug 24 10:18:52.670551 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 120/241] 10.222.0.30 () {60 vars in 1316 bytes} [Wed Aug 24 10:18:52 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:18:52.734027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b790a563-ff86-4c89-a8a2-a1c0b6761068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:52.734027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b790a563-ff86-4c89-a8a2-a1c0b6761068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:52.741547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b790a563-ff86-4c89-a8a2-a1c0b6761068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.742832 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b790a563-ff86-4c89-a8a2-a1c0b6761068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.743442 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b790a563-ff86-4c89-a8a2-a1c0b6761068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:52.744459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b790a563-ff86-4c89-a8a2-a1c0b6761068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:52.745193 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b790a563-ff86-4c89-a8a2-a1c0b6761068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:52.745865 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b790a563-ff86-4c89-a8a2-a1c0b6761068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:53.045780 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0112e8e5-56e2-4113-b991-d8bdb7909733 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.194511 Aug 24 10:18:53.051995 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 122/242] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:18:51 2022] POST /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 194 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:53.208384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b790a563-ff86-4c89-a8a2-a1c0b6761068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:53.218751 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b790a563-ff86-4c89-a8a2-a1c0b6761068 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.490335 Aug 24 10:18:53.219328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 121/243] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:52 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:53.999729 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-86d52bc0-209e-4d79-ad63-1985086384ff req-db4336fd-502b-4f58-8e9c-032b6ffa3c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac36f3b6-c66c-406b-b472-0a2dd018d4c3", "tag": "9fdb04de-4902-4316-8683-e37dc854e2b3"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:54.020135 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-86d52bc0-209e-4d79-ad63-1985086384ff req-db4336fd-502b-4f58-8e9c-032b6ffa3c72 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:54.020612 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-86d52bc0-209e-4d79-ad63-1985086384ff req-db4336fd-502b-4f58-8e9c-032b6ffa3c72 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:54.021136 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-86d52bc0-209e-4d79-ad63-1985086384ff req-db4336fd-502b-4f58-8e9c-032b6ffa3c72 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:54.042836 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-86d52bc0-209e-4d79-ad63-1985086384ff req-db4336fd-502b-4f58-8e9c-032b6ffa3c72 service nova] Creating event network-changed:9fdb04de-4902-4316-8683-e37dc854e2b3 for instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 on hv-cinder-85427 Aug 24 10:18:54.044343 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-86d52bc0-209e-4d79-ad63-1985086384ff req-db4336fd-502b-4f58-8e9c-032b6ffa3c72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049883 Aug 24 10:18:54.048218 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 123/244] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:54.241030 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-aa53f2e9-ee37-4c84-89d2-85218792d36f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:54.241712 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-aa53f2e9-ee37-4c84-89d2-85218792d36f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:54.248761 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa53f2e9-ee37-4c84-89d2-85218792d36f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:54.249399 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa53f2e9-ee37-4c84-89d2-85218792d36f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:54.249988 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa53f2e9-ee37-4c84-89d2-85218792d36f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:54.250761 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa53f2e9-ee37-4c84-89d2-85218792d36f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:54.251391 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa53f2e9-ee37-4c84-89d2-85218792d36f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:54.251842 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa53f2e9-ee37-4c84-89d2-85218792d36f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:54.456363 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-aa53f2e9-ee37-4c84-89d2-85218792d36f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:54.465504 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-aa53f2e9-ee37-4c84-89d2-85218792d36f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.229388 Aug 24 10:18:54.466099 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 122/245] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:54 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:55.487003 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1387136996", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "networks": [{"uuid": "e33227df-cea5-4f0a-9c63-39a52b589abd"}]}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:55.487517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f47f65f2-e32f-4a55-848c-a32c1948aa44 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:55.488681 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f47f65f2-e32f-4a55-848c-a32c1948aa44 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:55.495765 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f47f65f2-e32f-4a55-848c-a32c1948aa44 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.496241 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f47f65f2-e32f-4a55-848c-a32c1948aa44 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.496752 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f47f65f2-e32f-4a55-848c-a32c1948aa44 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.497662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f47f65f2-e32f-4a55-848c-a32c1948aa44 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.498486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f47f65f2-e32f-4a55-848c-a32c1948aa44 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.499082 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f47f65f2-e32f-4a55-848c-a32c1948aa44 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.542332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.network.neutron [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] validate_networks() for [('e33227df-cea5-4f0a-9c63-39a52b589abd', None, None, None, None, None)] {{(pid=121271) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:18:55.640502 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f47f65f2-e32f-4a55-848c-a32c1948aa44 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:55.648363 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f47f65f2-e32f-4a55-848c-a32c1948aa44 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1503 microversion: 2.1 time: 0.164631 Aug 24 10:18:55.648960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 123/246] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:55 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:55.674002 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e50b3483-b5c0-4c7c-a749-0083298eecb5"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:55.676449 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:55.682837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.683612 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.684062 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.685063 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.685526 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.685949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.712033 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] HTTP exception thrown: Cannot 'attach_volume' instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 while it is in vm_state rescued Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Request method failure captured: Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: POST /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634/os-volume_attachments HTTP/1.1 Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 74 Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqeZL8TowYsedOYEynKAPOP9RwdHJIc2D-gELfWWCOmFE4l4co3BDidi-uSQEN7L1Eopi2D_J-scSLzQMafxChW6tVTjZzwAINMHAMdJkgGIX9f6AYn2sKPGG8VZdURC1cZvC1knKHb2lC5R8pG-zv0XHn6P3W5Q3vftEcgy2ZHOSU Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 66a7713fb6804b4db1fbd15fa71afa74 Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:18:55.714993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66a7713fb6804b4db1fbd15fa71afa74", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 66a7713fb6804b4db1fbd15fa71afa74 Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-ServerRescueNegativeTestJSON-314780275-project Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 388174c87a2245ca89a634f3b177e166 Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-ServerRescueNegativeTestJSON-314780275-project Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {"volumeAttachment": {"volumeId": "e50b3483-b5c0-4c7c-a749-0083298eecb5"}} Aug 24 10:18:55.716428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Cannot 'attach_volume' instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 while it is in vm_state rescued Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'server_id': '9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634', 'body': {'volumeAttachment': {'volumeId': 'e50b3483-b5c0-4c7c-a749-0083298eecb5'}}} Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:55.717384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 while it is in vm_state rescued Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:55.718655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:55.720355 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:55.720355 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:55.720355 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 while it is in vm_state rescued Aug 24 10:18:55.720355 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:18:55.720355 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Returning 409 to user: Cannot 'attach_volume' instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 while it is in vm_state rescued {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:55.720355 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4275c19c-0686-4630-90a9-6e47c52298f9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046666 Aug 24 10:18:55.721008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 124/247] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:18:55 2022] POST /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:18:55.725863 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-93c8f284-40be-40e3-aece-b4f171f7b4bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b380dc08-ffd0-4df6-a4ba-f80fcbf9466c"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:55.728150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-93c8f284-40be-40e3-aece-b4f171f7b4bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:55.734599 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c8f284-40be-40e3-aece-b4f171f7b4bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.735553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c8f284-40be-40e3-aece-b4f171f7b4bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.735553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c8f284-40be-40e3-aece-b4f171f7b4bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.736694 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c8f284-40be-40e3-aece-b4f171f7b4bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.736694 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c8f284-40be-40e3-aece-b4f171f7b4bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.737066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c8f284-40be-40e3-aece-b4f171f7b4bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.912429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Flavor limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:18:55.912920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Image limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:18:55.913387 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Flavor pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:18:55.913802 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Image pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:18:55.914241 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:18:55.923274 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.923753 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.924185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.924931 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:55.925387 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:55.925811 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:55.943230 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Getting quotas for project 5cd097a59291481ab5cd35689765e9bc. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:18:55.947140 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Getting quotas for user dff7bd7a1a3f48b696c0e36a6d15757a and project 5cd097a59291481ab5cd35689765e9bc. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:18:55.959453 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Going to run 1 instances... {{(pid=121271) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:18:55.961880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:18:56.090872 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-08ff5ecf-b38d-4d62-b760-a975fbfc3231 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608392 Aug 24 10:18:56.092250 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 124/248] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:18:56.096951 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-929c383d-07c9-48e5-9cf0-1e5c91d8f88c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:56.097480 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-929c383d-07c9-48e5-9cf0-1e5c91d8f88c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:56.104426 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929c383d-07c9-48e5-9cf0-1e5c91d8f88c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:56.105542 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929c383d-07c9-48e5-9cf0-1e5c91d8f88c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:56.105756 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929c383d-07c9-48e5-9cf0-1e5c91d8f88c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:56.106423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929c383d-07c9-48e5-9cf0-1e5c91d8f88c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:56.106864 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929c383d-07c9-48e5-9cf0-1e5c91d8f88c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:56.107287 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929c383d-07c9-48e5-9cf0-1e5c91d8f88c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:56.490675 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-929c383d-07c9-48e5-9cf0-1e5c91d8f88c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634/action" status: 202 len: 0 microversion: 2.1 time: 0.397134 Aug 24 10:18:56.491304 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 125/249] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:18:56 2022] POST /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:18:56.496766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7cf1964f-a3da-47f5-9c9a-408bc90f1d05 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:56.497483 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7cf1964f-a3da-47f5-9c9a-408bc90f1d05 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:56.550869 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7cf1964f-a3da-47f5-9c9a-408bc90f1d05 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:56.558497 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7cf1964f-a3da-47f5-9c9a-408bc90f1d05 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1214 microversion: 2.1 time: 0.065614 Aug 24 10:18:56.559092 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 126/250] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:56 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:56.563763 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a7eaab22-b01b-4cca-a230-e054cac16e17 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:56.564833 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a7eaab22-b01b-4cca-a230-e054cac16e17 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:56.578020 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a7eaab22-b01b-4cca-a230-e054cac16e17 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:56.578505 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a7eaab22-b01b-4cca-a230-e054cac16e17 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:56.578939 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a7eaab22-b01b-4cca-a230-e054cac16e17 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:56.579679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a7eaab22-b01b-4cca-a230-e054cac16e17 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:56.580156 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a7eaab22-b01b-4cca-a230-e054cac16e17 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:56.580545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a7eaab22-b01b-4cca-a230-e054cac16e17 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:56.601087 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-93c8f284-40be-40e3-aece-b4f171f7b4bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.878768 Aug 24 10:18:56.601819 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 125/251] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:18:55 2022] POST /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/os-volume_attachments => generated 194 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:56.779920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a7eaab22-b01b-4cca-a230-e054cac16e17 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:56.792373 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a7eaab22-b01b-4cca-a230-e054cac16e17 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1511 microversion: 2.1 time: 0.231608 Aug 24 10:18:56.793076 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 127/252] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:56 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:57.592442 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c5e98eca-8653-46d6-a817-7bb30783d003 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:57.593210 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c5e98eca-8653-46d6-a817-7bb30783d003 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:57.599265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5e98eca-8653-46d6-a817-7bb30783d003 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:57.599743 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5e98eca-8653-46d6-a817-7bb30783d003 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:57.600168 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5e98eca-8653-46d6-a817-7bb30783d003 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:57.600849 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5e98eca-8653-46d6-a817-7bb30783d003 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:57.609489 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5e98eca-8653-46d6-a817-7bb30783d003 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:57.609489 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5e98eca-8653-46d6-a817-7bb30783d003 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:57.673281 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c5e98eca-8653-46d6-a817-7bb30783d003 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:57.681347 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c5e98eca-8653-46d6-a817-7bb30783d003 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1218 microversion: 2.1 time: 0.093643 Aug 24 10:18:57.681920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 126/253] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:57 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:57.815224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4fa3fe43-2690-4f3a-861b-78860e25560d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:57.815807 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4fa3fe43-2690-4f3a-861b-78860e25560d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:57.822479 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4fa3fe43-2690-4f3a-861b-78860e25560d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:57.822950 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4fa3fe43-2690-4f3a-861b-78860e25560d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:57.823376 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4fa3fe43-2690-4f3a-861b-78860e25560d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:57.824222 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4fa3fe43-2690-4f3a-861b-78860e25560d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:57.828919 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4fa3fe43-2690-4f3a-861b-78860e25560d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:57.828919 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4fa3fe43-2690-4f3a-861b-78860e25560d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:57.958948 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4fa3fe43-2690-4f3a-861b-78860e25560d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:57.966600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4fa3fe43-2690-4f3a-861b-78860e25560d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1511 microversion: 2.1 time: 0.155262 Aug 24 10:18:57.967163 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 128/254] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:57 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:58.703246 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-743763c1-0149-4a44-91ca-8ad7033fb8eb tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:58.703856 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-743763c1-0149-4a44-91ca-8ad7033fb8eb tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:58.710557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-743763c1-0149-4a44-91ca-8ad7033fb8eb tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:58.711033 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-743763c1-0149-4a44-91ca-8ad7033fb8eb tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:58.711517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-743763c1-0149-4a44-91ca-8ad7033fb8eb tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:58.712168 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-743763c1-0149-4a44-91ca-8ad7033fb8eb tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:58.712615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-743763c1-0149-4a44-91ca-8ad7033fb8eb tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:58.713067 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-743763c1-0149-4a44-91ca-8ad7033fb8eb tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:58.773808 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-743763c1-0149-4a44-91ca-8ad7033fb8eb tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:58.782989 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-743763c1-0149-4a44-91ca-8ad7033fb8eb tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1210 microversion: 2.1 time: 0.084241 Aug 24 10:18:58.783654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 127/255] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:58 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:58.992745 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-33cb41b9-8725-4167-820a-29fdf7f656b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:58.994530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-33cb41b9-8725-4167-820a-29fdf7f656b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:59.002919 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33cb41b9-8725-4167-820a-29fdf7f656b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.003607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33cb41b9-8725-4167-820a-29fdf7f656b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.004168 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33cb41b9-8725-4167-820a-29fdf7f656b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.005021 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33cb41b9-8725-4167-820a-29fdf7f656b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.005688 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33cb41b9-8725-4167-820a-29fdf7f656b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.007783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-33cb41b9-8725-4167-820a-29fdf7f656b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.182018 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-33cb41b9-8725-4167-820a-29fdf7f656b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:59.190517 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-33cb41b9-8725-4167-820a-29fdf7f656b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1511 microversion: 2.1 time: 0.206012 Aug 24 10:18:59.191075 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 129/256] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:58 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:59.804367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d51c738a-9a0e-47e9-9e23-db24333aeeb1 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:59.805008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d51c738a-9a0e-47e9-9e23-db24333aeeb1 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:59.807411 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=68 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:59.812510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d51c738a-9a0e-47e9-9e23-db24333aeeb1 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.813027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d51c738a-9a0e-47e9-9e23-db24333aeeb1 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.813467 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d51c738a-9a0e-47e9-9e23-db24333aeeb1 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.814217 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d51c738a-9a0e-47e9-9e23-db24333aeeb1 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:59.814679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d51c738a-9a0e-47e9-9e23-db24333aeeb1 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:59.815099 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d51c738a-9a0e-47e9-9e23-db24333aeeb1 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:59.878413 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d51c738a-9a0e-47e9-9e23-db24333aeeb1 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:59.881782 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:59.886120 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d51c738a-9a0e-47e9-9e23-db24333aeeb1 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1266 microversion: 2.1 time: 0.085725 Aug 24 10:18:59.886695 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 128/257] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:59 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:00.211671 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-372f1024-52e8-4787-9bd9-110a49375e27 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:00.212332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-372f1024-52e8-4787-9bd9-110a49375e27 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:00.214795 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:00.220568 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-372f1024-52e8-4787-9bd9-110a49375e27 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:00.221085 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-372f1024-52e8-4787-9bd9-110a49375e27 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:00.221517 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-372f1024-52e8-4787-9bd9-110a49375e27 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:00.222214 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-372f1024-52e8-4787-9bd9-110a49375e27 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:00.223219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-372f1024-52e8-4787-9bd9-110a49375e27 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:00.223834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-372f1024-52e8-4787-9bd9-110a49375e27 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:00.360289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-372f1024-52e8-4787-9bd9-110a49375e27 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:00.368766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-372f1024-52e8-4787-9bd9-110a49375e27 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1517 microversion: 2.1 time: 0.160915 Aug 24 10:19:00.369388 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 130/258] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:00 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:00.906940 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c7d973a6-9eff-4ac7-a470-9470ec0e20f3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:00.907557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c7d973a6-9eff-4ac7-a470-9470ec0e20f3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:00.914628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d973a6-9eff-4ac7-a470-9470ec0e20f3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:00.915098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d973a6-9eff-4ac7-a470-9470ec0e20f3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:00.915524 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d973a6-9eff-4ac7-a470-9470ec0e20f3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:00.916209 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d973a6-9eff-4ac7-a470-9470ec0e20f3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:00.921114 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d973a6-9eff-4ac7-a470-9470ec0e20f3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:00.921114 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d973a6-9eff-4ac7-a470-9470ec0e20f3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:00.994388 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c7d973a6-9eff-4ac7-a470-9470ec0e20f3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:01.007941 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c7d973a6-9eff-4ac7-a470-9470ec0e20f3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1274 microversion: 2.1 time: 0.105054 Aug 24 10:19:01.008848 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 129/259] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:00 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:01.969083 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-15d48631-f427-490d-822d-ca51e990db6a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: .version_select at 0x7f0af44da040>, body: {"keypair": {"name": "tempest-keypair-2119419808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/Ayyu/A9Wko1t7SAFYgtLBjJdX6V6Rc9hE6PC12/ZdE09d89EVq+tO/SxKYNHFNFyipTkLyVchpW4A9M4UeWuCKvfeDPE8TBWLmwsBvjQbRyCxen/7JsQ1vQlLaOrMVg=="}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:01.989717 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-15d48631-f427-490d-822d-ca51e990db6a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for project 8824664cdd104c308141264985a547a1. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:01.994394 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-15d48631-f427-490d-822d-ca51e990db6a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for user c94c65ae14e94796a3b3bd0bb29a91b9 and project 8824664cdd104c308141264985a547a1. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:02.030769 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6ebcdcf3-c554-4f66-b199-b87a8520a799 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:02.031318 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6ebcdcf3-c554-4f66-b199-b87a8520a799 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:02.038680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebcdcf3-c554-4f66-b199-b87a8520a799 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:02.039190 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebcdcf3-c554-4f66-b199-b87a8520a799 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:02.039691 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebcdcf3-c554-4f66-b199-b87a8520a799 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:02.041915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebcdcf3-c554-4f66-b199-b87a8520a799 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:02.041915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebcdcf3-c554-4f66-b199-b87a8520a799 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:02.041915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebcdcf3-c554-4f66-b199-b87a8520a799 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:02.062062 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-15d48631-f427-490d-822d-ca51e990db6a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099564 Aug 24 10:19:02.062933 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 131/260] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Aug 24 10:19:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:02.138537 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8b27be0d-fae5-435e-ab00-995f0163ab85 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'create', calling method: .version_select at 0x7f0af4404310>, body: {"keypair": {"name": "tempest-keypair-260994801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhD59XSfQog9Y3ik7GuUse1cWKI69qBGR2MZ2v5zzZkywL5/lUC3qad7xgLrHw+M59Zsk3yWfAzcMDFm2vEOtl4nLc/o0cH6GNuqsnKUwbe+7z+JDtDj+n3IgVpow4OTw=="}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:02.155578 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-8b27be0d-fae5-435e-ab00-995f0163ab85 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Getting quotas for project 66a7713fb6804b4db1fbd15fa71afa74. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:02.159667 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-8b27be0d-fae5-435e-ab00-995f0163ab85 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Getting quotas for user 388174c87a2245ca89a634f3b177e166 and project 66a7713fb6804b4db1fbd15fa71afa74. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:02.243346 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8b27be0d-fae5-435e-ab00-995f0163ab85 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110301 Aug 24 10:19:02.243946 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 132/261] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Aug 24 10:19:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:02.244372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6ebcdcf3-c554-4f66-b199-b87a8520a799 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:02.252521 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6ebcdcf3-c554-4f66-b199-b87a8520a799 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1314 microversion: 2.1 time: 0.226246 Aug 24 10:19:02.253115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 130/262] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:02 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:02.689577 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-fc793670-d3b4-4f49-8364-163bc697b59f req-9dd94b6c-43ad-44d3-a806-3042603f1711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cadd22ee-d183-43eb-9efa-2c01c9c757a5", "tag": "27ab9c11-5a40-4b75-95bd-4e86b807d90c"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:02.699083 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fc793670-d3b4-4f49-8364-163bc697b59f req-9dd94b6c-43ad-44d3-a806-3042603f1711 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:02.699555 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fc793670-d3b4-4f49-8364-163bc697b59f req-9dd94b6c-43ad-44d3-a806-3042603f1711 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:02.699980 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fc793670-d3b4-4f49-8364-163bc697b59f req-9dd94b6c-43ad-44d3-a806-3042603f1711 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:02.713604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-fc793670-d3b4-4f49-8364-163bc697b59f req-9dd94b6c-43ad-44d3-a806-3042603f1711 service nova] Creating event network-changed:27ab9c11-5a40-4b75-95bd-4e86b807d90c for instance cadd22ee-d183-43eb-9efa-2c01c9c757a5 on hv-cinder-85427 Aug 24 10:19:02.718604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-fc793670-d3b4-4f49-8364-163bc697b59f req-9dd94b6c-43ad-44d3-a806-3042603f1711 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035075 Aug 24 10:19:02.719429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 133/263] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:03.275161 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0e3273be-f91d-4ea9-b4b6-643a6ad94e26 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:03.276435 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0e3273be-f91d-4ea9-b4b6-643a6ad94e26 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:03.283535 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e3273be-f91d-4ea9-b4b6-643a6ad94e26 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:03.283996 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e3273be-f91d-4ea9-b4b6-643a6ad94e26 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:03.284425 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e3273be-f91d-4ea9-b4b6-643a6ad94e26 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:03.285150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e3273be-f91d-4ea9-b4b6-643a6ad94e26 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:03.285615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e3273be-f91d-4ea9-b4b6-643a6ad94e26 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:03.286021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e3273be-f91d-4ea9-b4b6-643a6ad94e26 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:03.519728 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0e3273be-f91d-4ea9-b4b6-643a6ad94e26 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:03.527911 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0e3273be-f91d-4ea9-b4b6-643a6ad94e26 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1314 microversion: 2.1 time: 0.256612 Aug 24 10:19:03.531684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 131/264] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:03 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:04.529826 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1735869093", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd93ff68-1984-453a-90ae-b4e36ac7c98e"}], "security_groups": [{"name": "tempest-securitygroup--729228111"}], "key_name": "tempest-keypair-2119419808", "user_data": "}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:04.550300 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3a0d0461-0a4d-40f4-adc0-e68ae0a3cc5a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:04.551519 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3a0d0461-0a4d-40f4-adc0-e68ae0a3cc5a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:04.557871 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a0d0461-0a4d-40f4-adc0-e68ae0a3cc5a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:04.558507 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a0d0461-0a4d-40f4-adc0-e68ae0a3cc5a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:04.559007 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a0d0461-0a4d-40f4-adc0-e68ae0a3cc5a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:04.560470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a0d0461-0a4d-40f4-adc0-e68ae0a3cc5a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:04.561286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a0d0461-0a4d-40f4-adc0-e68ae0a3cc5a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:04.561820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a0d0461-0a4d-40f4-adc0-e68ae0a3cc5a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:04.646253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.network.neutron [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] validate_networks() for [('cd93ff68-1984-453a-90ae-b4e36ac7c98e', None, None, None, None, None)] {{(pid=121271) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:19:04.785172 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3a0d0461-0a4d-40f4-adc0-e68ae0a3cc5a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:04.795894 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3a0d0461-0a4d-40f4-adc0-e68ae0a3cc5a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1314 microversion: 2.1 time: 0.248715 Aug 24 10:19:04.810844 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 132/265] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:04 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:05.099111 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Flavor limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:19:05.099539 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Image limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:19:05.100012 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Flavor pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:19:05.100430 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Image pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:19:05.100846 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:19:05.115046 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.115535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.115974 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.116701 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.117186 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.117615 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.135506 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for project 8824664cdd104c308141264985a547a1. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:05.139760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for user c94c65ae14e94796a3b3bd0bb29a91b9 and project 8824664cdd104c308141264985a547a1. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:05.152370 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Going to run 1 instances... {{(pid=121271) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:19:05.155810 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:19:05.206026 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1036230242", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd8e81e0-99a4-4b0d-840b-c6d4a60fe43d"}], "security_groups": [{"name": "tempest-securitygroup--270148475"}], "key_name": "tempest-keypair-260994801", "user_data": "}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:05.301118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bf603a89-e7dc-4164-abe2-1aa846d278d0 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.776499 Aug 24 10:19:05.302048 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 134/266] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:19:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:19:05.313459 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a1f28cd9-fa40-4ea2-8e21-d3c6764d905b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:05.314081 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a1f28cd9-fa40-4ea2-8e21-d3c6764d905b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:05.315127 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] validate_networks() for [('cd8e81e0-99a4-4b0d-840b-c6d4a60fe43d', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:19:05.375773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a1f28cd9-fa40-4ea2-8e21-d3c6764d905b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:05.385372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a1f28cd9-fa40-4ea2-8e21-d3c6764d905b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1242 microversion: 2.1 time: 0.075905 Aug 24 10:19:05.386917 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 135/267] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:05 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:05.725184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:19:05.725682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:19:05.726069 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:19:05.726508 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:19:05.726921 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:19:05.736776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.737295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.737732 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.738458 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.738910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.739333 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.756707 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Getting quotas for project 66a7713fb6804b4db1fbd15fa71afa74. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:05.760901 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Getting quotas for user 388174c87a2245ca89a634f3b177e166 and project 66a7713fb6804b4db1fbd15fa71afa74. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:05.772352 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:19:05.774718 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:19:05.819800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9b4c1864-7a24-4bd2-8b90-8e1d2995aacd tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:05.820466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9b4c1864-7a24-4bd2-8b90-8e1d2995aacd tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:05.827889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b4c1864-7a24-4bd2-8b90-8e1d2995aacd tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.828376 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b4c1864-7a24-4bd2-8b90-8e1d2995aacd tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.828808 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b4c1864-7a24-4bd2-8b90-8e1d2995aacd tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.829543 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b4c1864-7a24-4bd2-8b90-8e1d2995aacd tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:05.830008 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b4c1864-7a24-4bd2-8b90-8e1d2995aacd tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:05.830412 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b4c1864-7a24-4bd2-8b90-8e1d2995aacd tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:05.958219 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bf2a2ef2-5b6c-42db-a7ad-d265151d6728 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.756571 Aug 24 10:19:05.959284 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 133/268] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:19:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:19:05.971014 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-65eef66f-c373-4f80-9d0b-50dcc9e65369 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:05.971711 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-65eef66f-c373-4f80-9d0b-50dcc9e65369 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:05.980682 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9b4c1864-7a24-4bd2-8b90-8e1d2995aacd tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:05.991325 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9b4c1864-7a24-4bd2-8b90-8e1d2995aacd tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1314 microversion: 2.1 time: 0.175463 Aug 24 10:19:05.994881 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 136/269] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:05 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:06.030099 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-65eef66f-c373-4f80-9d0b-50dcc9e65369 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:06.036922 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-65eef66f-c373-4f80-9d0b-50dcc9e65369 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1245 microversion: 2.1 time: 0.069828 Aug 24 10:19:06.037488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 134/270] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:05 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:06.407922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3384f46a-e762-4b97-a9a0-fdf5ea7c3b13 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:06.408567 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3384f46a-e762-4b97-a9a0-fdf5ea7c3b13 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:06.415257 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3384f46a-e762-4b97-a9a0-fdf5ea7c3b13 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:06.415738 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3384f46a-e762-4b97-a9a0-fdf5ea7c3b13 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:06.416169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3384f46a-e762-4b97-a9a0-fdf5ea7c3b13 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:06.416879 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3384f46a-e762-4b97-a9a0-fdf5ea7c3b13 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:06.417332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3384f46a-e762-4b97-a9a0-fdf5ea7c3b13 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:06.417752 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3384f46a-e762-4b97-a9a0-fdf5ea7c3b13 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:06.480545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3384f46a-e762-4b97-a9a0-fdf5ea7c3b13 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:06.490710 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3384f46a-e762-4b97-a9a0-fdf5ea7c3b13 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1246 microversion: 2.1 time: 0.086824 Aug 24 10:19:06.491360 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 137/271] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:06 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:06.783130 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-e6d84cbe-742c-4073-afee-dc13a60b3997 req-e8e94e5f-552a-4b0c-89b8-cd07f795b6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cadd22ee-d183-43eb-9efa-2c01c9c757a5", "name": "network-vif-plugged", "status": "completed", "tag": "27ab9c11-5a40-4b75-95bd-4e86b807d90c"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:06.793409 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e6d84cbe-742c-4073-afee-dc13a60b3997 req-e8e94e5f-552a-4b0c-89b8-cd07f795b6fb service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:06.794412 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e6d84cbe-742c-4073-afee-dc13a60b3997 req-e8e94e5f-552a-4b0c-89b8-cd07f795b6fb service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:06.794929 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e6d84cbe-742c-4073-afee-dc13a60b3997 req-e8e94e5f-552a-4b0c-89b8-cd07f795b6fb service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:06.805907 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-e6d84cbe-742c-4073-afee-dc13a60b3997 req-e8e94e5f-552a-4b0c-89b8-cd07f795b6fb service nova] Creating event network-vif-plugged:27ab9c11-5a40-4b75-95bd-4e86b807d90c for instance cadd22ee-d183-43eb-9efa-2c01c9c757a5 on hv-cinder-85427 Aug 24 10:19:06.812452 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-e6d84cbe-742c-4073-afee-dc13a60b3997 req-e8e94e5f-552a-4b0c-89b8-cd07f795b6fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032816 Aug 24 10:19:06.813625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 135/272] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:07.015429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-97695c73-ec0e-401e-88aa-f762ee40f532 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:07.016004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-97695c73-ec0e-401e-88aa-f762ee40f532 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:07.022478 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97695c73-ec0e-401e-88aa-f762ee40f532 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:07.022983 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97695c73-ec0e-401e-88aa-f762ee40f532 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:07.023424 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97695c73-ec0e-401e-88aa-f762ee40f532 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:07.024115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97695c73-ec0e-401e-88aa-f762ee40f532 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:07.024587 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97695c73-ec0e-401e-88aa-f762ee40f532 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:07.025064 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97695c73-ec0e-401e-88aa-f762ee40f532 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:07.060382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6ed94216-0a7a-4ed5-9e66-876ea455a1f7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:07.061328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6ed94216-0a7a-4ed5-9e66-876ea455a1f7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:07.070566 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ed94216-0a7a-4ed5-9e66-876ea455a1f7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:07.071296 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ed94216-0a7a-4ed5-9e66-876ea455a1f7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:07.071735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ed94216-0a7a-4ed5-9e66-876ea455a1f7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:07.072439 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ed94216-0a7a-4ed5-9e66-876ea455a1f7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:07.072947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ed94216-0a7a-4ed5-9e66-876ea455a1f7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:07.073372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ed94216-0a7a-4ed5-9e66-876ea455a1f7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:07.137938 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6ed94216-0a7a-4ed5-9e66-876ea455a1f7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:07.146578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6ed94216-0a7a-4ed5-9e66-876ea455a1f7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1249 microversion: 2.1 time: 0.091887 Aug 24 10:19:07.147264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 136/273] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:07 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:07.163881 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-97695c73-ec0e-401e-88aa-f762ee40f532 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:07.172380 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-97695c73-ec0e-401e-88aa-f762ee40f532 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1314 microversion: 2.1 time: 0.161771 Aug 24 10:19:07.173068 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 138/274] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:07 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:07.511842 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cbbcb28a-5742-4f4a-9302-127733f862ca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:07.512450 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cbbcb28a-5742-4f4a-9302-127733f862ca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:07.520541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbbcb28a-5742-4f4a-9302-127733f862ca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:07.521050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbbcb28a-5742-4f4a-9302-127733f862ca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:07.521482 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbbcb28a-5742-4f4a-9302-127733f862ca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:07.522174 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbbcb28a-5742-4f4a-9302-127733f862ca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:07.522653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbbcb28a-5742-4f4a-9302-127733f862ca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:07.523075 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbbcb28a-5742-4f4a-9302-127733f862ca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:07.587794 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cbbcb28a-5742-4f4a-9302-127733f862ca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:07.595578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cbbcb28a-5742-4f4a-9302-127733f862ca tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1294 microversion: 2.1 time: 0.087887 Aug 24 10:19:07.596143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 137/275] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:07 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:08.168616 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-edadd7b8-1623-4c17-ae35-d33930edfed1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:08.170422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-edadd7b8-1623-4c17-ae35-d33930edfed1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:08.176467 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-edadd7b8-1623-4c17-ae35-d33930edfed1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.176981 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-edadd7b8-1623-4c17-ae35-d33930edfed1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.177418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-edadd7b8-1623-4c17-ae35-d33930edfed1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.178105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-edadd7b8-1623-4c17-ae35-d33930edfed1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.178556 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-edadd7b8-1623-4c17-ae35-d33930edfed1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.178977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-edadd7b8-1623-4c17-ae35-d33930edfed1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.193310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2357afcd-42d4-4052-8c5d-4092fdfb0a90 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:08.193943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2357afcd-42d4-4052-8c5d-4092fdfb0a90 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:08.202248 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2357afcd-42d4-4052-8c5d-4092fdfb0a90 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.203295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2357afcd-42d4-4052-8c5d-4092fdfb0a90 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.203441 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2357afcd-42d4-4052-8c5d-4092fdfb0a90 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.204020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2357afcd-42d4-4052-8c5d-4092fdfb0a90 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.204526 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2357afcd-42d4-4052-8c5d-4092fdfb0a90 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.205016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2357afcd-42d4-4052-8c5d-4092fdfb0a90 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.246612 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-edadd7b8-1623-4c17-ae35-d33930edfed1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.250750 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:08.255591 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-edadd7b8-1623-4c17-ae35-d33930edfed1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1297 microversion: 2.1 time: 0.090737 Aug 24 10:19:08.256195 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 139/276] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:08 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:08.474425 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2357afcd-42d4-4052-8c5d-4092fdfb0a90 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.483397 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2357afcd-42d4-4052-8c5d-4092fdfb0a90 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1314 microversion: 2.1 time: 0.293882 Aug 24 10:19:08.484003 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 138/277] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:08 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:08.624134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2fd36efc-012e-4a3b-a587-dfe554edd976 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:08.624754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2fd36efc-012e-4a3b-a587-dfe554edd976 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:08.631052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fd36efc-012e-4a3b-a587-dfe554edd976 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.631532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fd36efc-012e-4a3b-a587-dfe554edd976 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.631965 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fd36efc-012e-4a3b-a587-dfe554edd976 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.632656 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fd36efc-012e-4a3b-a587-dfe554edd976 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:08.633195 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fd36efc-012e-4a3b-a587-dfe554edd976 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:08.633625 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fd36efc-012e-4a3b-a587-dfe554edd976 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:08.694603 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2fd36efc-012e-4a3b-a587-dfe554edd976 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:08.702144 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2fd36efc-012e-4a3b-a587-dfe554edd976 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1302 microversion: 2.1 time: 0.082988 Aug 24 10:19:08.702711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 140/278] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:08 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:09.277635 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c968df21-6a71-41f1-afe2-7fba5cbe212d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:09.278847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c968df21-6a71-41f1-afe2-7fba5cbe212d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:09.285548 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c968df21-6a71-41f1-afe2-7fba5cbe212d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.289729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c968df21-6a71-41f1-afe2-7fba5cbe212d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.289729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c968df21-6a71-41f1-afe2-7fba5cbe212d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.289729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c968df21-6a71-41f1-afe2-7fba5cbe212d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.289729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c968df21-6a71-41f1-afe2-7fba5cbe212d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.290115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c968df21-6a71-41f1-afe2-7fba5cbe212d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.351450 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c968df21-6a71-41f1-afe2-7fba5cbe212d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:09.359547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c968df21-6a71-41f1-afe2-7fba5cbe212d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1297 microversion: 2.1 time: 0.085803 Aug 24 10:19:09.360110 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 139/279] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:09 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:09.522115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-cb3a6c1b-4d56-4c3c-8f2e-3cba552d47e5 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:09.522742 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-cb3a6c1b-4d56-4c3c-8f2e-3cba552d47e5 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:09.529670 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb3a6c1b-4d56-4c3c-8f2e-3cba552d47e5 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.530087 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb3a6c1b-4d56-4c3c-8f2e-3cba552d47e5 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.530522 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb3a6c1b-4d56-4c3c-8f2e-3cba552d47e5 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.531216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb3a6c1b-4d56-4c3c-8f2e-3cba552d47e5 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.531667 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb3a6c1b-4d56-4c3c-8f2e-3cba552d47e5 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.532092 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb3a6c1b-4d56-4c3c-8f2e-3cba552d47e5 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.664530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-cb3a6c1b-4d56-4c3c-8f2e-3cba552d47e5 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:09.672654 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-cb3a6c1b-4d56-4c3c-8f2e-3cba552d47e5 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1314 microversion: 2.1 time: 0.154742 Aug 24 10:19:09.673293 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 141/280] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:09 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:09.722521 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0e88c008-a1c3-4579-9316-fbd2ccce0238 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:09.723130 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0e88c008-a1c3-4579-9316-fbd2ccce0238 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:09.731341 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e88c008-a1c3-4579-9316-fbd2ccce0238 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.732107 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e88c008-a1c3-4579-9316-fbd2ccce0238 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.732549 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e88c008-a1c3-4579-9316-fbd2ccce0238 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.733349 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e88c008-a1c3-4579-9316-fbd2ccce0238 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:09.733874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e88c008-a1c3-4579-9316-fbd2ccce0238 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:09.734236 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0e88c008-a1c3-4579-9316-fbd2ccce0238 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:09.800727 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0e88c008-a1c3-4579-9316-fbd2ccce0238 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:09.808278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0e88c008-a1c3-4579-9316-fbd2ccce0238 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1300 microversion: 2.1 time: 0.089600 Aug 24 10:19:09.808831 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 140/281] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:09 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:10.384528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8e303e5a-c89b-4e96-afe9-2d6bc6fcc815 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:10.385168 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8e303e5a-c89b-4e96-afe9-2d6bc6fcc815 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:10.391046 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8e303e5a-c89b-4e96-afe9-2d6bc6fcc815 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.391520 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8e303e5a-c89b-4e96-afe9-2d6bc6fcc815 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.391945 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8e303e5a-c89b-4e96-afe9-2d6bc6fcc815 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.392691 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8e303e5a-c89b-4e96-afe9-2d6bc6fcc815 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.393167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8e303e5a-c89b-4e96-afe9-2d6bc6fcc815 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.393819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8e303e5a-c89b-4e96-afe9-2d6bc6fcc815 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.458304 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8e303e5a-c89b-4e96-afe9-2d6bc6fcc815 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:10.467709 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8e303e5a-c89b-4e96-afe9-2d6bc6fcc815 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1297 microversion: 2.1 time: 0.088865 Aug 24 10:19:10.468635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 142/282] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:10 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:10.693457 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4b422eb7-e66e-45cd-99d0-a28698206362 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:10.694056 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4b422eb7-e66e-45cd-99d0-a28698206362 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:10.701283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b422eb7-e66e-45cd-99d0-a28698206362 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.701743 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b422eb7-e66e-45cd-99d0-a28698206362 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.702171 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b422eb7-e66e-45cd-99d0-a28698206362 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.702852 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b422eb7-e66e-45cd-99d0-a28698206362 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.703347 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b422eb7-e66e-45cd-99d0-a28698206362 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.703770 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b422eb7-e66e-45cd-99d0-a28698206362 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.831090 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-317f4ede-8fe2-42f3-9e4a-36be31f71dc3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:10.831798 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-317f4ede-8fe2-42f3-9e4a-36be31f71dc3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:10.836622 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4b422eb7-e66e-45cd-99d0-a28698206362 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:10.838616 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-317f4ede-8fe2-42f3-9e4a-36be31f71dc3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.839122 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-317f4ede-8fe2-42f3-9e4a-36be31f71dc3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.839643 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-317f4ede-8fe2-42f3-9e4a-36be31f71dc3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.840355 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-317f4ede-8fe2-42f3-9e4a-36be31f71dc3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:10.841497 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-317f4ede-8fe2-42f3-9e4a-36be31f71dc3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:10.841953 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-317f4ede-8fe2-42f3-9e4a-36be31f71dc3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:10.845125 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4b422eb7-e66e-45cd-99d0-a28698206362 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1497 microversion: 2.1 time: 0.155740 Aug 24 10:19:10.845684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 141/283] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:10 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:10.978338 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-317f4ede-8fe2-42f3-9e4a-36be31f71dc3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:10.987272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-317f4ede-8fe2-42f3-9e4a-36be31f71dc3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1367 microversion: 2.1 time: 0.160118 Aug 24 10:19:10.987901 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 143/284] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:10 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:11.499808 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cb13f763-63af-4342-8616-35f0c14673dd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:11.500742 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cb13f763-63af-4342-8616-35f0c14673dd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:11.508959 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb13f763-63af-4342-8616-35f0c14673dd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.509588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb13f763-63af-4342-8616-35f0c14673dd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.510081 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb13f763-63af-4342-8616-35f0c14673dd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.510991 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb13f763-63af-4342-8616-35f0c14673dd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.511436 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb13f763-63af-4342-8616-35f0c14673dd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.512170 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cb13f763-63af-4342-8616-35f0c14673dd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.633678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cb13f763-63af-4342-8616-35f0c14673dd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:11.643933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cb13f763-63af-4342-8616-35f0c14673dd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1303 microversion: 2.1 time: 0.147866 Aug 24 10:19:11.645336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 142/285] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:11 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:11.691951 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-afa84d6b-07f6-4dd0-b13d-c6b23a55faae tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:11.698994 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-afa84d6b-07f6-4dd0-b13d-c6b23a55faae tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.699706 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-afa84d6b-07f6-4dd0-b13d-c6b23a55faae tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.700222 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-afa84d6b-07f6-4dd0-b13d-c6b23a55faae tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.762078 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-afa84d6b-07f6-4dd0-b13d-c6b23a55faae tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Going to try to stop instance {{(pid=121271) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:19:11.840127 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-c05fc9d9-12b5-4efc-9b91-22198263f9db req-cf99a721-c14a-4e6d-821f-d9778b574efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a33b6e4-dee4-4e74-9125-2023095d167a", "tag": "4b428aa4-0631-4aa6-82a7-97e1e11db86e"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:11.852327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c05fc9d9-12b5-4efc-9b91-22198263f9db req-cf99a721-c14a-4e6d-821f-d9778b574efe service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:11.852805 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c05fc9d9-12b5-4efc-9b91-22198263f9db req-cf99a721-c14a-4e6d-821f-d9778b574efe service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:11.853333 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c05fc9d9-12b5-4efc-9b91-22198263f9db req-cf99a721-c14a-4e6d-821f-d9778b574efe service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:11.868667 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-c05fc9d9-12b5-4efc-9b91-22198263f9db req-cf99a721-c14a-4e6d-821f-d9778b574efe service nova] Creating event network-changed:4b428aa4-0631-4aa6-82a7-97e1e11db86e for instance 4a33b6e4-dee4-4e74-9125-2023095d167a on hv-cinder-85427 Aug 24 10:19:11.874935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-c05fc9d9-12b5-4efc-9b91-22198263f9db req-cf99a721-c14a-4e6d-821f-d9778b574efe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038851 Aug 24 10:19:11.875539 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 143/286] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:12.009797 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b948f952-3004-43da-ada2-929ab2aa4c19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:12.010511 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b948f952-3004-43da-ada2-929ab2aa4c19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:12.017964 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b948f952-3004-43da-ada2-929ab2aa4c19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.018808 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b948f952-3004-43da-ada2-929ab2aa4c19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.019408 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b948f952-3004-43da-ada2-929ab2aa4c19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.020291 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b948f952-3004-43da-ada2-929ab2aa4c19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.020934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b948f952-3004-43da-ada2-929ab2aa4c19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.021936 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b948f952-3004-43da-ada2-929ab2aa4c19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.028333 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-afa84d6b-07f6-4dd0-b13d-c6b23a55faae tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/action" status: 202 len: 0 microversion: 2.1 time: 0.344217 Aug 24 10:19:12.030786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 144/287] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:19:11 2022] POST /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:19:12.058521 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e608c025-b29d-44a3-a334-10951b62ec1d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:12.059568 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e608c025-b29d-44a3-a334-10951b62ec1d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:12.069143 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e608c025-b29d-44a3-a334-10951b62ec1d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.069723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e608c025-b29d-44a3-a334-10951b62ec1d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.070222 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e608c025-b29d-44a3-a334-10951b62ec1d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.070995 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e608c025-b29d-44a3-a334-10951b62ec1d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.072449 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e608c025-b29d-44a3-a334-10951b62ec1d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.073114 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e608c025-b29d-44a3-a334-10951b62ec1d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.258321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e608c025-b29d-44a3-a334-10951b62ec1d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.264251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e608c025-b29d-44a3-a334-10951b62ec1d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.218787 Aug 24 10:19:12.274068 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b948f952-3004-43da-ada2-929ab2aa4c19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.274469 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b948f952-3004-43da-ada2-929ab2aa4c19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1367 microversion: 2.1 time: 0.268854 Aug 24 10:19:12.274867 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 145/288] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:12 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:12.275547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 144/289] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:12 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:12.284484 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8cc63705-1d48-41ba-b601-0e2d12bbb78c tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:12.285110 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8cc63705-1d48-41ba-b601-0e2d12bbb78c tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:12.291656 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8cc63705-1d48-41ba-b601-0e2d12bbb78c tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.292227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8cc63705-1d48-41ba-b601-0e2d12bbb78c tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.292672 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8cc63705-1d48-41ba-b601-0e2d12bbb78c tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.293427 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8cc63705-1d48-41ba-b601-0e2d12bbb78c tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.294204 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8cc63705-1d48-41ba-b601-0e2d12bbb78c tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.294945 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8cc63705-1d48-41ba-b601-0e2d12bbb78c tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.323067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8cc63705-1d48-41ba-b601-0e2d12bbb78c tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:19:12.641262 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8cc63705-1d48-41ba-b601-0e2d12bbb78c tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 204 len: 0 microversion: 2.1 time: 0.362934 Aug 24 10:19:12.642070 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 146/290] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:19:12 2022] DELETE /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:12.651859 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-49f1b8ff-833c-4cff-b672-eb54ef8feadf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:12.652927 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-49f1b8ff-833c-4cff-b672-eb54ef8feadf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:12.661219 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f1b8ff-833c-4cff-b672-eb54ef8feadf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.661986 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f1b8ff-833c-4cff-b672-eb54ef8feadf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.662619 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f1b8ff-833c-4cff-b672-eb54ef8feadf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.663526 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f1b8ff-833c-4cff-b672-eb54ef8feadf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.664168 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f1b8ff-833c-4cff-b672-eb54ef8feadf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.666633 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49f1b8ff-833c-4cff-b672-eb54ef8feadf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.675819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-115d17e3-6d26-4fcb-b054-1154b65df423 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:12.680815 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-115d17e3-6d26-4fcb-b054-1154b65df423 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:12.686053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-115d17e3-6d26-4fcb-b054-1154b65df423 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.687581 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-115d17e3-6d26-4fcb-b054-1154b65df423 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.688947 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-115d17e3-6d26-4fcb-b054-1154b65df423 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.689909 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-115d17e3-6d26-4fcb-b054-1154b65df423 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:12.690579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-115d17e3-6d26-4fcb-b054-1154b65df423 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:12.691016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-115d17e3-6d26-4fcb-b054-1154b65df423 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:12.805530 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-49f1b8ff-833c-4cff-b672-eb54ef8feadf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.813475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-49f1b8ff-833c-4cff-b672-eb54ef8feadf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1503 microversion: 2.1 time: 0.167177 Aug 24 10:19:12.814238 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 145/291] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:12 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:12.849094 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-115d17e3-6d26-4fcb-b054-1154b65df423 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:12.855188 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-115d17e3-6d26-4fcb-b054-1154b65df423 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1370 microversion: 2.1 time: 0.187264 Aug 24 10:19:12.855768 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 147/292] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:12 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:13.120533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-c32e91aa-e88d-42e7-91c7-838dc1b00f4b req-8b0118b6-73a9-4164-ad68-88b9393f8ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa35bff-3f3e-4a84-af4f-cdb62e5a4481", "tag": "50a4db0b-fe10-4ecc-9fab-c39a1162c94a"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:13.131822 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c32e91aa-e88d-42e7-91c7-838dc1b00f4b req-8b0118b6-73a9-4164-ad68-88b9393f8ecc service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.132281 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c32e91aa-e88d-42e7-91c7-838dc1b00f4b req-8b0118b6-73a9-4164-ad68-88b9393f8ecc service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.132705 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c32e91aa-e88d-42e7-91c7-838dc1b00f4b req-8b0118b6-73a9-4164-ad68-88b9393f8ecc service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.144910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-c32e91aa-e88d-42e7-91c7-838dc1b00f4b req-8b0118b6-73a9-4164-ad68-88b9393f8ecc service nova] Creating event network-changed:50a4db0b-fe10-4ecc-9fab-c39a1162c94a for instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 on hv-cinder-85427 Aug 24 10:19:13.149627 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-c32e91aa-e88d-42e7-91c7-838dc1b00f4b req-8b0118b6-73a9-4164-ad68-88b9393f8ecc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033473 Aug 24 10:19:13.150748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 146/293] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:13.285713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-309cfc71-e71f-438d-ba7f-5b9cdd7b7511 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:13.286228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-309cfc71-e71f-438d-ba7f-5b9cdd7b7511 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:13.292372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-309cfc71-e71f-438d-ba7f-5b9cdd7b7511 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.292886 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-309cfc71-e71f-438d-ba7f-5b9cdd7b7511 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.293360 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-309cfc71-e71f-438d-ba7f-5b9cdd7b7511 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.294293 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-309cfc71-e71f-438d-ba7f-5b9cdd7b7511 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.294800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-309cfc71-e71f-438d-ba7f-5b9cdd7b7511 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.295251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-309cfc71-e71f-438d-ba7f-5b9cdd7b7511 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.296675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-aaa36e31-2a50-4f3d-88d9-e8cf5065a6b2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:13.297404 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-aaa36e31-2a50-4f3d-88d9-e8cf5065a6b2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:13.303615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aaa36e31-2a50-4f3d-88d9-e8cf5065a6b2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.304090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aaa36e31-2a50-4f3d-88d9-e8cf5065a6b2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.304593 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aaa36e31-2a50-4f3d-88d9-e8cf5065a6b2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.305345 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aaa36e31-2a50-4f3d-88d9-e8cf5065a6b2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.305792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aaa36e31-2a50-4f3d-88d9-e8cf5065a6b2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.306215 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aaa36e31-2a50-4f3d-88d9-e8cf5065a6b2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.439667 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-aaa36e31-2a50-4f3d-88d9-e8cf5065a6b2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.440578 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-309cfc71-e71f-438d-ba7f-5b9cdd7b7511 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.447593 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-aaa36e31-2a50-4f3d-88d9-e8cf5065a6b2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1367 microversion: 2.1 time: 0.155800 Aug 24 10:19:13.448167 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 147/294] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:13 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:13.448636 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-309cfc71-e71f-438d-ba7f-5b9cdd7b7511 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.167002 Aug 24 10:19:13.449228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 148/295] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:13 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:13.835226 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-27487193-1d57-4c18-a2ee-2c16b77f3281 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:13.835831 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-27487193-1d57-4c18-a2ee-2c16b77f3281 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:13.842011 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-27487193-1d57-4c18-a2ee-2c16b77f3281 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.842484 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-27487193-1d57-4c18-a2ee-2c16b77f3281 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.842913 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-27487193-1d57-4c18-a2ee-2c16b77f3281 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.843597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-27487193-1d57-4c18-a2ee-2c16b77f3281 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.844159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-27487193-1d57-4c18-a2ee-2c16b77f3281 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.844515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-27487193-1d57-4c18-a2ee-2c16b77f3281 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.877567 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-86f73039-3577-4187-9ec5-3407d61b134b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:13.878276 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-86f73039-3577-4187-9ec5-3407d61b134b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:13.884976 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86f73039-3577-4187-9ec5-3407d61b134b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.885464 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86f73039-3577-4187-9ec5-3407d61b134b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.885898 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86f73039-3577-4187-9ec5-3407d61b134b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.886599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86f73039-3577-4187-9ec5-3407d61b134b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:13.887051 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86f73039-3577-4187-9ec5-3407d61b134b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:13.887585 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86f73039-3577-4187-9ec5-3407d61b134b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:13.976664 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-27487193-1d57-4c18-a2ee-2c16b77f3281 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:13.985385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-27487193-1d57-4c18-a2ee-2c16b77f3281 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1503 microversion: 2.1 time: 0.154016 Aug 24 10:19:13.986056 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 148/296] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:13 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:14.020067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-86f73039-3577-4187-9ec5-3407d61b134b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:14.027607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-86f73039-3577-4187-9ec5-3407d61b134b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1370 microversion: 2.1 time: 0.153860 Aug 24 10:19:14.028668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 149/297] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:13 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:14.469740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-82fbd277-4317-42f0-a767-2ef4862f706e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:14.470396 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-82fbd277-4317-42f0-a767-2ef4862f706e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:14.472078 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6a06c975-0f3f-4bcd-842c-f6d8e4129fc3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:14.472701 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-6a06c975-0f3f-4bcd-842c-f6d8e4129fc3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:14.476773 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82fbd277-4317-42f0-a767-2ef4862f706e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.477289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82fbd277-4317-42f0-a767-2ef4862f706e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.477723 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82fbd277-4317-42f0-a767-2ef4862f706e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:14.478476 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82fbd277-4317-42f0-a767-2ef4862f706e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.478895 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82fbd277-4317-42f0-a767-2ef4862f706e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.479318 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82fbd277-4317-42f0-a767-2ef4862f706e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:14.479588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a06c975-0f3f-4bcd-842c-f6d8e4129fc3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.480067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a06c975-0f3f-4bcd-842c-f6d8e4129fc3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.480494 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a06c975-0f3f-4bcd-842c-f6d8e4129fc3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:14.481274 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a06c975-0f3f-4bcd-842c-f6d8e4129fc3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:14.481645 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a06c975-0f3f-4bcd-842c-f6d8e4129fc3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:14.482062 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a06c975-0f3f-4bcd-842c-f6d8e4129fc3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:14.484653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:14.699177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6a06c975-0f3f-4bcd-842c-f6d8e4129fc3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:14.709887 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-6a06c975-0f3f-4bcd-842c-f6d8e4129fc3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.244009 Aug 24 10:19:14.710759 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 150/298] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:14 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:14.732507 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-82fbd277-4317-42f0-a767-2ef4862f706e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:14.738223 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-82fbd277-4317-42f0-a767-2ef4862f706e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1367 microversion: 2.1 time: 0.272959 Aug 24 10:19:14.738994 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 149/299] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:14 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:15.006535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-750addb4-53f0-4ffe-92f5-fa616249423e tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:15.007164 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-750addb4-53f0-4ffe-92f5-fa616249423e tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:15.014498 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-750addb4-53f0-4ffe-92f5-fa616249423e tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.017149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-750addb4-53f0-4ffe-92f5-fa616249423e tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.017149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-750addb4-53f0-4ffe-92f5-fa616249423e tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.017149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-750addb4-53f0-4ffe-92f5-fa616249423e tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.017149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-750addb4-53f0-4ffe-92f5-fa616249423e tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.017742 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-750addb4-53f0-4ffe-92f5-fa616249423e tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.049740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1b309e2e-7310-4999-ba0b-9b81a7887290 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:15.050347 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1b309e2e-7310-4999-ba0b-9b81a7887290 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:15.056442 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1b309e2e-7310-4999-ba0b-9b81a7887290 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.056958 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1b309e2e-7310-4999-ba0b-9b81a7887290 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.057390 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1b309e2e-7310-4999-ba0b-9b81a7887290 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.058083 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1b309e2e-7310-4999-ba0b-9b81a7887290 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.058532 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1b309e2e-7310-4999-ba0b-9b81a7887290 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.058952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1b309e2e-7310-4999-ba0b-9b81a7887290 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.126264 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=4 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:15.161319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-750addb4-53f0-4ffe-92f5-fa616249423e tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:15.171547 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-750addb4-53f0-4ffe-92f5-fa616249423e tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1503 microversion: 2.1 time: 0.169326 Aug 24 10:19:15.177461 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 151/300] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:15 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:15.246187 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1b309e2e-7310-4999-ba0b-9b81a7887290 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:15.254170 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1b309e2e-7310-4999-ba0b-9b81a7887290 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1370 microversion: 2.1 time: 0.208133 Aug 24 10:19:15.254874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 150/301] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:15 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:15.665860 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-bbb2934c-2b6f-4dc6-9cfb-8da11bcd92c1 req-c8f4649b-4e7b-42b2-b6d1-e0b2456d9afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cadd22ee-d183-43eb-9efa-2c01c9c757a5", "name": "network-vif-deleted", "tag": "27ab9c11-5a40-4b75-95bd-4e86b807d90c"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:15.670810 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=24 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:15.676081 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-bbb2934c-2b6f-4dc6-9cfb-8da11bcd92c1 req-c8f4649b-4e7b-42b2-b6d1-e0b2456d9afd service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.677185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-bbb2934c-2b6f-4dc6-9cfb-8da11bcd92c1 req-c8f4649b-4e7b-42b2-b6d1-e0b2456d9afd service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.677185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-bbb2934c-2b6f-4dc6-9cfb-8da11bcd92c1 req-c8f4649b-4e7b-42b2-b6d1-e0b2456d9afd service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.689069 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-bbb2934c-2b6f-4dc6-9cfb-8da11bcd92c1 req-c8f4649b-4e7b-42b2-b6d1-e0b2456d9afd service nova] Creating event network-vif-deleted:27ab9c11-5a40-4b75-95bd-4e86b807d90c for instance cadd22ee-d183-43eb-9efa-2c01c9c757a5 on hv-cinder-85427 Aug 24 10:19:15.693881 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-bbb2934c-2b6f-4dc6-9cfb-8da11bcd92c1 req-c8f4649b-4e7b-42b2-b6d1-e0b2456d9afd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031704 Aug 24 10:19:15.694488 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 152/302] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:15.731346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-75412c43-0a94-4cf4-b657-dbee11b7b360 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:15.732109 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-75412c43-0a94-4cf4-b657-dbee11b7b360 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:15.739275 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75412c43-0a94-4cf4-b657-dbee11b7b360 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.740035 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75412c43-0a94-4cf4-b657-dbee11b7b360 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.740470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75412c43-0a94-4cf4-b657-dbee11b7b360 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.741238 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75412c43-0a94-4cf4-b657-dbee11b7b360 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.741689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75412c43-0a94-4cf4-b657-dbee11b7b360 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.742113 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75412c43-0a94-4cf4-b657-dbee11b7b360 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.748406 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:15.761959 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b1261c5f-a7f5-46c0-8f2a-9c7392747937 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:15.763330 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b1261c5f-a7f5-46c0-8f2a-9c7392747937 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:15.770359 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1261c5f-a7f5-46c0-8f2a-9c7392747937 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.770758 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1261c5f-a7f5-46c0-8f2a-9c7392747937 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.771284 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1261c5f-a7f5-46c0-8f2a-9c7392747937 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.771904 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1261c5f-a7f5-46c0-8f2a-9c7392747937 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:15.772359 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1261c5f-a7f5-46c0-8f2a-9c7392747937 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:15.772997 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b1261c5f-a7f5-46c0-8f2a-9c7392747937 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:15.890523 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-75412c43-0a94-4cf4-b657-dbee11b7b360 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:15.899578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-75412c43-0a94-4cf4-b657-dbee11b7b360 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.172259 Aug 24 10:19:15.904479 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 151/303] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:15 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:15.921271 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b1261c5f-a7f5-46c0-8f2a-9c7392747937 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:15.929100 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b1261c5f-a7f5-46c0-8f2a-9c7392747937 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1367 microversion: 2.1 time: 0.171432 Aug 24 10:19:15.929692 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 153/304] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:15 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:16.200670 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cf4c9b4a-a13b-41bd-ac11-a45d807e9a3a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:16.201586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cf4c9b4a-a13b-41bd-ac11-a45d807e9a3a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:16.203871 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=8 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:16.209115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cf4c9b4a-a13b-41bd-ac11-a45d807e9a3a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.209686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cf4c9b4a-a13b-41bd-ac11-a45d807e9a3a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.210211 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cf4c9b4a-a13b-41bd-ac11-a45d807e9a3a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.210876 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cf4c9b4a-a13b-41bd-ac11-a45d807e9a3a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.211321 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cf4c9b4a-a13b-41bd-ac11-a45d807e9a3a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.211739 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cf4c9b4a-a13b-41bd-ac11-a45d807e9a3a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.276628 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0a4e9ac5-fc75-4d81-8916-874156a50a14 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:16.277227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0a4e9ac5-fc75-4d81-8916-874156a50a14 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:16.284483 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a4e9ac5-fc75-4d81-8916-874156a50a14 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.285015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a4e9ac5-fc75-4d81-8916-874156a50a14 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.285490 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a4e9ac5-fc75-4d81-8916-874156a50a14 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.286193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a4e9ac5-fc75-4d81-8916-874156a50a14 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.286649 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a4e9ac5-fc75-4d81-8916-874156a50a14 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.287128 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a4e9ac5-fc75-4d81-8916-874156a50a14 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.305931 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cf4c9b4a-a13b-41bd-ac11-a45d807e9a3a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.312782 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:16.316582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cf4c9b4a-a13b-41bd-ac11-a45d807e9a3a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1299 microversion: 2.1 time: 0.120783 Aug 24 10:19:16.317550 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 152/305] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:16 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:16.426461 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0a4e9ac5-fc75-4d81-8916-874156a50a14 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:16.433957 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0a4e9ac5-fc75-4d81-8916-874156a50a14 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1370 microversion: 2.1 time: 0.161217 Aug 24 10:19:16.435123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 154/306] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:16 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:16.923410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-65398747-c346-4ccf-b92c-941d9e9e3c03 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:16.924215 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-65398747-c346-4ccf-b92c-941d9e9e3c03 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:16.930792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-65398747-c346-4ccf-b92c-941d9e9e3c03 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.931277 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-65398747-c346-4ccf-b92c-941d9e9e3c03 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.931722 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-65398747-c346-4ccf-b92c-941d9e9e3c03 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.932598 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-65398747-c346-4ccf-b92c-941d9e9e3c03 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.933057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-65398747-c346-4ccf-b92c-941d9e9e3c03 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.933482 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-65398747-c346-4ccf-b92c-941d9e9e3c03 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.952003 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-57fcebd9-b19a-4c7c-8b82-120b5179d6c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:16.953263 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-57fcebd9-b19a-4c7c-8b82-120b5179d6c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:16.960689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-57fcebd9-b19a-4c7c-8b82-120b5179d6c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.961204 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-57fcebd9-b19a-4c7c-8b82-120b5179d6c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.961644 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-57fcebd9-b19a-4c7c-8b82-120b5179d6c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:16.962499 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-57fcebd9-b19a-4c7c-8b82-120b5179d6c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:16.962965 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-57fcebd9-b19a-4c7c-8b82-120b5179d6c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:16.963388 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-57fcebd9-b19a-4c7c-8b82-120b5179d6c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.070741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-65398747-c346-4ccf-b92c-941d9e9e3c03 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:17.079320 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-65398747-c346-4ccf-b92c-941d9e9e3c03 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.160575 Aug 24 10:19:17.079828 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 153/307] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:16 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:17.100289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-57fcebd9-b19a-4c7c-8b82-120b5179d6c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:17.108577 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-57fcebd9-b19a-4c7c-8b82-120b5179d6c8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1367 microversion: 2.1 time: 0.160886 Aug 24 10:19:17.109169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 155/308] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:16 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:17.339016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:17.339609 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:17.346344 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.346831 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.347268 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.348508 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.348508 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.348845 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.379682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.380168 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.380606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.381091 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lazy-loading 'fault' on Instance uuid cadd22ee-d183-43eb-9efa-2c01c9c757a5 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:19:17.425253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:17.433008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-48a5f6a4-25a5-4ed5-85f6-3786f9b623af tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 200 len: 1304 microversion: 2.1 time: 0.097962 Aug 24 10:19:17.433579 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 154/309] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:17 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:17.456110 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9982a1da-320e-4176-95b4-8748c293cbc8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:17.456727 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9982a1da-320e-4176-95b4-8748c293cbc8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:17.463514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9982a1da-320e-4176-95b4-8748c293cbc8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.464000 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9982a1da-320e-4176-95b4-8748c293cbc8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.464439 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9982a1da-320e-4176-95b4-8748c293cbc8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.465194 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9982a1da-320e-4176-95b4-8748c293cbc8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:17.466332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9982a1da-320e-4176-95b4-8748c293cbc8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:17.466764 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9982a1da-320e-4176-95b4-8748c293cbc8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:17.596430 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9982a1da-320e-4176-95b4-8748c293cbc8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:17.604318 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9982a1da-320e-4176-95b4-8748c293cbc8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1370 microversion: 2.1 time: 0.152359 Aug 24 10:19:17.604822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 156/310] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:17 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:18.101513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f48b8d15-9a58-4753-9cd4-e83503524a30 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:18.102130 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f48b8d15-9a58-4753-9cd4-e83503524a30 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:18.109295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f48b8d15-9a58-4753-9cd4-e83503524a30 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.109772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f48b8d15-9a58-4753-9cd4-e83503524a30 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.110196 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f48b8d15-9a58-4753-9cd4-e83503524a30 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.110897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f48b8d15-9a58-4753-9cd4-e83503524a30 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.111346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f48b8d15-9a58-4753-9cd4-e83503524a30 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.111775 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f48b8d15-9a58-4753-9cd4-e83503524a30 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.132365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ccc33deb-0d37-4326-a56a-ae9e638dad9b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:18.135077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ccc33deb-0d37-4326-a56a-ae9e638dad9b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:18.144560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ccc33deb-0d37-4326-a56a-ae9e638dad9b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.149195 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ccc33deb-0d37-4326-a56a-ae9e638dad9b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.149395 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ccc33deb-0d37-4326-a56a-ae9e638dad9b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.150234 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ccc33deb-0d37-4326-a56a-ae9e638dad9b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.150797 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ccc33deb-0d37-4326-a56a-ae9e638dad9b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.151324 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ccc33deb-0d37-4326-a56a-ae9e638dad9b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.266225 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f48b8d15-9a58-4753-9cd4-e83503524a30 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.276508 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f48b8d15-9a58-4753-9cd4-e83503524a30 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.179384 Aug 24 10:19:18.277117 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 155/311] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:18 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:18.298381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-ccc33deb-0d37-4326-a56a-ae9e638dad9b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.305902 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ccc33deb-0d37-4326-a56a-ae9e638dad9b tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1367 microversion: 2.1 time: 0.178473 Aug 24 10:19:18.306486 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 157/312] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:18 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:18.454568 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:18.455181 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: cadd22ee-d183-43eb-9efa-2c01c9c757a5] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:18.461144 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.461729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.462214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.462852 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.463306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.463732 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.477508 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] HTTP exception thrown: Instance cadd22ee-d183-43eb-9efa-2c01c9c757a5 could not be found. Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Request method failure captured: Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 HTTP/1.1 Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfsNYbRnoDeMUfoxS3d61hiZjlFraqgvHum00WmmKdsEhv7_Z9D_lBLE_NYQ3I6BEeU8elVLUn1k-l05PaPnKLgu8y9RrjolNXdm31fSrS_Pv-6SH-X3ecZcWvjleqF6fid3vV_AGZF4HBzBbj6nHC7A9J3BZwtWcblUKhOtFf_38EE Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 5cd097a59291481ab5cd35689765e9bc Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-VolumesActionsTest-2107266854 Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:19:18.479169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5cd097a59291481ab5cd35689765e9bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5cd097a59291481ab5cd35689765e9bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5cd097a59291481ab5cd35689765e9bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5cd097a59291481ab5cd35689765e9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-VolumesActionsTest-2107266854 Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 5cd097a59291481ab5cd35689765e9bc Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-VolumesActionsTest-2107266854 Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-VolumesActionsTest-2107266854-project Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: dff7bd7a1a3f48b696c0e36a6d15757a Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-VolumesActionsTest-2107266854-project Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance cadd22ee-d183-43eb-9efa-2c01c9c757a5 could not be found. Aug 24 10:19:18.480663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': 'cadd22ee-d183-43eb-9efa-2c01c9c757a5'} Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cadd22ee-d183-43eb-9efa-2c01c9c757a5 could not be found. Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:18.482653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cadd22ee-d183-43eb-9efa-2c01c9c757a5 could not be found. Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cadd22ee-d183-43eb-9efa-2c01c9c757a5 could not be found. Aug 24 10:19:18.483823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:19:18.484884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Returning 404 to user: Instance cadd22ee-d183-43eb-9efa-2c01c9c757a5 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:18.484884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c4288fa1-e10e-4ae2-b52f-d49cd1c35616 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5" status: 404 len: 111 microversion: 2.1 time: 0.030014 Aug 24 10:19:18.484884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 156/313] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:18 2022] GET /compute/v2.1/servers/cadd22ee-d183-43eb-9efa-2c01c9c757a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:19:18.532418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1378448936", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "networks": [{"uuid": "e33227df-cea5-4f0a-9c63-39a52b589abd"}]}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:18.540913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:18.586181 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.network.neutron [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] validate_networks() for [('e33227df-cea5-4f0a-9c63-39a52b589abd', None, None, None, None, None)] {{(pid=121271) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:19:18.626242 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d3d64b21-e891-462b-8c93-3c491235de98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:18.626872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d3d64b21-e891-462b-8c93-3c491235de98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:18.634040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d3d64b21-e891-462b-8c93-3c491235de98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.645585 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d3d64b21-e891-462b-8c93-3c491235de98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.645585 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d3d64b21-e891-462b-8c93-3c491235de98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.645585 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d3d64b21-e891-462b-8c93-3c491235de98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.645585 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d3d64b21-e891-462b-8c93-3c491235de98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.646096 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d3d64b21-e891-462b-8c93-3c491235de98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.778938 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d3d64b21-e891-462b-8c93-3c491235de98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:18.787805 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d3d64b21-e891-462b-8c93-3c491235de98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1370 microversion: 2.1 time: 0.165600 Aug 24 10:19:18.788895 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 157/314] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:18 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:18.953164 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Flavor limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:19:18.956633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Image limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:19:18.956633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Flavor pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:19:18.956633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Image pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:19:18.956633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:19:18.967080 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.967980 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.968641 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.969419 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.969883 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.970194 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-503efe67-85fd-43c6-9700-792510f78f0f req-c386a237-5243-4073-becc-529643315e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a33b6e4-dee4-4e74-9125-2023095d167a", "name": "network-vif-plugged", "status": "completed", "tag": "4b428aa4-0631-4aa6-82a7-97e1e11db86e"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:18.970309 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.980297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-503efe67-85fd-43c6-9700-792510f78f0f req-c386a237-5243-4073-becc-529643315e18 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:18.980803 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-503efe67-85fd-43c6-9700-792510f78f0f req-c386a237-5243-4073-becc-529643315e18 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:18.981925 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-503efe67-85fd-43c6-9700-792510f78f0f req-c386a237-5243-4073-becc-529643315e18 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:18.989724 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Getting quotas for project 5cd097a59291481ab5cd35689765e9bc. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:19:18.994381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Getting quotas for user dff7bd7a1a3f48b696c0e36a6d15757a and project 5cd097a59291481ab5cd35689765e9bc. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:19:18.994540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-503efe67-85fd-43c6-9700-792510f78f0f req-c386a237-5243-4073-becc-529643315e18 service nova] Creating event network-vif-plugged:4b428aa4-0631-4aa6-82a7-97e1e11db86e for instance 4a33b6e4-dee4-4e74-9125-2023095d167a on hv-cinder-85427 Aug 24 10:19:19.000361 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-503efe67-85fd-43c6-9700-792510f78f0f req-c386a237-5243-4073-becc-529643315e18 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034906 Aug 24 10:19:19.001361 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 158/315] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:19.007178 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Going to run 1 instances... {{(pid=121271) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:19:19.009553 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:19:19.158104 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3418a9ee-95a2-4e4a-a3cd-b7b3f1432414 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629955 Aug 24 10:19:19.159098 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 158/316] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:19:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:19:19.171620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-590b7db7-463c-4706-8727-91d6cc54b8ec tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:19.172500 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-590b7db7-463c-4706-8727-91d6cc54b8ec tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:19.230792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-590b7db7-463c-4706-8727-91d6cc54b8ec tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:19.240061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-590b7db7-463c-4706-8727-91d6cc54b8ec tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1214 microversion: 2.1 time: 0.073745 Aug 24 10:19:19.241708 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 159/317] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:19 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:19.298096 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a51a80b2-7dda-4c62-8c67-8f0661272469 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:19.298721 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a51a80b2-7dda-4c62-8c67-8f0661272469 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:19.305216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a51a80b2-7dda-4c62-8c67-8f0661272469 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:19.305707 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a51a80b2-7dda-4c62-8c67-8f0661272469 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:19.306145 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a51a80b2-7dda-4c62-8c67-8f0661272469 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:19.306903 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a51a80b2-7dda-4c62-8c67-8f0661272469 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:19.307362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a51a80b2-7dda-4c62-8c67-8f0661272469 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:19.307790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a51a80b2-7dda-4c62-8c67-8f0661272469 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:19.328064 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a3046785-a050-47e7-8895-100ec4543f4d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:19.329204 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a3046785-a050-47e7-8895-100ec4543f4d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:19.336069 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3046785-a050-47e7-8895-100ec4543f4d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:19.336630 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3046785-a050-47e7-8895-100ec4543f4d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:19.337185 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3046785-a050-47e7-8895-100ec4543f4d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:19.337958 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3046785-a050-47e7-8895-100ec4543f4d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:19.338498 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3046785-a050-47e7-8895-100ec4543f4d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:19.339133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3046785-a050-47e7-8895-100ec4543f4d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:19.459988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a51a80b2-7dda-4c62-8c67-8f0661272469 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:19.470890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a51a80b2-7dda-4c62-8c67-8f0661272469 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.176231 Aug 24 10:19:19.471752 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 159/318] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:19 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:19.520476 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a3046785-a050-47e7-8895-100ec4543f4d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:19.532220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a3046785-a050-47e7-8895-100ec4543f4d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1367 microversion: 2.1 time: 0.208559 Aug 24 10:19:19.533883 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 160/319] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:19 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:19.810329 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-5d03eb18-e8f0-4317-b47f-5c44cf5561c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:19.811172 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-5d03eb18-e8f0-4317-b47f-5c44cf5561c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:19.817654 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5d03eb18-e8f0-4317-b47f-5c44cf5561c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:19.818146 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5d03eb18-e8f0-4317-b47f-5c44cf5561c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:19.818585 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5d03eb18-e8f0-4317-b47f-5c44cf5561c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:19.819289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5d03eb18-e8f0-4317-b47f-5c44cf5561c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:19.819749 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5d03eb18-e8f0-4317-b47f-5c44cf5561c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:19.820180 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5d03eb18-e8f0-4317-b47f-5c44cf5561c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:19.952537 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-5d03eb18-e8f0-4317-b47f-5c44cf5561c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:19.960518 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-5d03eb18-e8f0-4317-b47f-5c44cf5561c9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1370 microversion: 2.1 time: 0.155085 Aug 24 10:19:19.961125 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 160/320] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:19 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:20.261739 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d24e4809-0f3d-4479-af31-75523a15ca56 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:20.262867 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d24e4809-0f3d-4479-af31-75523a15ca56 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:20.269651 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d24e4809-0f3d-4479-af31-75523a15ca56 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.270073 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d24e4809-0f3d-4479-af31-75523a15ca56 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.270506 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d24e4809-0f3d-4479-af31-75523a15ca56 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.271201 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d24e4809-0f3d-4479-af31-75523a15ca56 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.271655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d24e4809-0f3d-4479-af31-75523a15ca56 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.272077 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d24e4809-0f3d-4479-af31-75523a15ca56 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.336947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d24e4809-0f3d-4479-af31-75523a15ca56 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.345736 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d24e4809-0f3d-4479-af31-75523a15ca56 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1218 microversion: 2.1 time: 0.087831 Aug 24 10:19:20.346315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 161/321] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:20 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:20.493543 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0d0226f3-d959-430b-b926-038fd2ccc924 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:20.494060 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0d0226f3-d959-430b-b926-038fd2ccc924 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:20.500422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d0226f3-d959-430b-b926-038fd2ccc924 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.500942 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d0226f3-d959-430b-b926-038fd2ccc924 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.501383 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d0226f3-d959-430b-b926-038fd2ccc924 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.502079 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d0226f3-d959-430b-b926-038fd2ccc924 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.502559 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d0226f3-d959-430b-b926-038fd2ccc924 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.502984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d0226f3-d959-430b-b926-038fd2ccc924 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.553989 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f9d23e7d-96c2-476c-8911-db359dd0c2f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:20.554710 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f9d23e7d-96c2-476c-8911-db359dd0c2f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:20.562031 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f9d23e7d-96c2-476c-8911-db359dd0c2f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.562588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f9d23e7d-96c2-476c-8911-db359dd0c2f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.563086 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f9d23e7d-96c2-476c-8911-db359dd0c2f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.563857 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f9d23e7d-96c2-476c-8911-db359dd0c2f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.564367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f9d23e7d-96c2-476c-8911-db359dd0c2f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.564795 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f9d23e7d-96c2-476c-8911-db359dd0c2f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.713517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f9d23e7d-96c2-476c-8911-db359dd0c2f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.722675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f9d23e7d-96c2-476c-8911-db359dd0c2f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1367 microversion: 2.1 time: 0.172467 Aug 24 10:19:20.723270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 162/322] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:20 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:20.888624 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0d0226f3-d959-430b-b926-038fd2ccc924 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:20.894787 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0d0226f3-d959-430b-b926-038fd2ccc924 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.405628 Aug 24 10:19:20.895434 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 161/323] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:20 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:20.982195 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cfd4b67f-1024-4dc9-97a7-1780596a1e88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:20.982921 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cfd4b67f-1024-4dc9-97a7-1780596a1e88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:20.989159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cfd4b67f-1024-4dc9-97a7-1780596a1e88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.989903 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cfd4b67f-1024-4dc9-97a7-1780596a1e88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.990338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cfd4b67f-1024-4dc9-97a7-1780596a1e88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:20.991032 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cfd4b67f-1024-4dc9-97a7-1780596a1e88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:20.991484 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cfd4b67f-1024-4dc9-97a7-1780596a1e88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:20.991906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cfd4b67f-1024-4dc9-97a7-1780596a1e88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.019476 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-0290aff8-963b-4798-889a-48c9a6813b17 req-7710e56a-37b2-4165-b5ac-cd092562957c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa35bff-3f3e-4a84-af4f-cdb62e5a4481", "name": "network-vif-plugged", "status": "completed", "tag": "50a4db0b-fe10-4ecc-9fab-c39a1162c94a"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:21.029469 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-0290aff8-963b-4798-889a-48c9a6813b17 req-7710e56a-37b2-4165-b5ac-cd092562957c service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.030068 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-0290aff8-963b-4798-889a-48c9a6813b17 req-7710e56a-37b2-4165-b5ac-cd092562957c service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.031774 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-0290aff8-963b-4798-889a-48c9a6813b17 req-7710e56a-37b2-4165-b5ac-cd092562957c service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.044891 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-0290aff8-963b-4798-889a-48c9a6813b17 req-7710e56a-37b2-4165-b5ac-cd092562957c service nova] Creating event network-vif-plugged:50a4db0b-fe10-4ecc-9fab-c39a1162c94a for instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 on hv-cinder-85427 Aug 24 10:19:21.050209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-0290aff8-963b-4798-889a-48c9a6813b17 req-7710e56a-37b2-4165-b5ac-cd092562957c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034313 Aug 24 10:19:21.050999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 162/324] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:21.128949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cfd4b67f-1024-4dc9-97a7-1780596a1e88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:21.136445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cfd4b67f-1024-4dc9-97a7-1780596a1e88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1370 microversion: 2.1 time: 0.158463 Aug 24 10:19:21.137035 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 163/325] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:20 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:21.367671 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-390d28be-e490-4c1f-bdb4-1ab1f79f7989 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:21.368372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-390d28be-e490-4c1f-bdb4-1ab1f79f7989 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:21.375702 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-390d28be-e490-4c1f-bdb4-1ab1f79f7989 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.376185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-390d28be-e490-4c1f-bdb4-1ab1f79f7989 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.376620 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-390d28be-e490-4c1f-bdb4-1ab1f79f7989 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.377350 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-390d28be-e490-4c1f-bdb4-1ab1f79f7989 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.377804 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-390d28be-e490-4c1f-bdb4-1ab1f79f7989 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.378228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-390d28be-e490-4c1f-bdb4-1ab1f79f7989 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.439459 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-390d28be-e490-4c1f-bdb4-1ab1f79f7989 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:21.447392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-390d28be-e490-4c1f-bdb4-1ab1f79f7989 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1210 microversion: 2.1 time: 0.084369 Aug 24 10:19:21.447959 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 163/326] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:21 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:21.745876 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-aa54fa2a-20d5-41b9-9431-20d0fbb90989 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:21.746490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-aa54fa2a-20d5-41b9-9431-20d0fbb90989 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:21.753244 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa54fa2a-20d5-41b9-9431-20d0fbb90989 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.753722 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa54fa2a-20d5-41b9-9431-20d0fbb90989 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.754152 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa54fa2a-20d5-41b9-9431-20d0fbb90989 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.754841 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa54fa2a-20d5-41b9-9431-20d0fbb90989 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.755288 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa54fa2a-20d5-41b9-9431-20d0fbb90989 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.755703 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aa54fa2a-20d5-41b9-9431-20d0fbb90989 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.899186 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-aa54fa2a-20d5-41b9-9431-20d0fbb90989 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:21.923385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-aa54fa2a-20d5-41b9-9431-20d0fbb90989 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1367 microversion: 2.1 time: 0.167017 Aug 24 10:19:21.923385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 164/327] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:21 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:21.923699 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-712749b7-15ab-4f28-b6b0-288f48ab5ad6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:21.923699 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-712749b7-15ab-4f28-b6b0-288f48ab5ad6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:21.923699 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-712749b7-15ab-4f28-b6b0-288f48ab5ad6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.923699 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-712749b7-15ab-4f28-b6b0-288f48ab5ad6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.924319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-712749b7-15ab-4f28-b6b0-288f48ab5ad6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:21.924705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-712749b7-15ab-4f28-b6b0-288f48ab5ad6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:21.925207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-712749b7-15ab-4f28-b6b0-288f48ab5ad6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:21.925632 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-712749b7-15ab-4f28-b6b0-288f48ab5ad6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.060836 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-712749b7-15ab-4f28-b6b0-288f48ab5ad6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:22.069511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-712749b7-15ab-4f28-b6b0-288f48ab5ad6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.157712 Aug 24 10:19:22.070077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 164/328] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:21 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:22.156426 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-675cdb86-cced-4488-9ab2-7d18504cccdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:22.157134 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-675cdb86-cced-4488-9ab2-7d18504cccdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:22.163125 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-675cdb86-cced-4488-9ab2-7d18504cccdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.163606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-675cdb86-cced-4488-9ab2-7d18504cccdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.164043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-675cdb86-cced-4488-9ab2-7d18504cccdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.164758 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-675cdb86-cced-4488-9ab2-7d18504cccdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.165242 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-675cdb86-cced-4488-9ab2-7d18504cccdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.165669 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-675cdb86-cced-4488-9ab2-7d18504cccdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.299229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-675cdb86-cced-4488-9ab2-7d18504cccdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:22.307268 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-675cdb86-cced-4488-9ab2-7d18504cccdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1370 microversion: 2.1 time: 0.154850 Aug 24 10:19:22.307829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 165/329] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:22 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:22.482331 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b6a6de66-3ead-436e-a593-db227ace6514 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:22.482854 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b6a6de66-3ead-436e-a593-db227ace6514 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:22.489903 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6a6de66-3ead-436e-a593-db227ace6514 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.490405 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6a6de66-3ead-436e-a593-db227ace6514 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.490857 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6a6de66-3ead-436e-a593-db227ace6514 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.491548 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6a6de66-3ead-436e-a593-db227ace6514 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.492005 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6a6de66-3ead-436e-a593-db227ace6514 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.492457 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6a6de66-3ead-436e-a593-db227ace6514 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.553088 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b6a6de66-3ead-436e-a593-db227ace6514 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:22.560662 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b6a6de66-3ead-436e-a593-db227ace6514 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1266 microversion: 2.1 time: 0.082419 Aug 24 10:19:22.561273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 165/330] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:22 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:22.931096 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a5b98644-770d-48a3-a7c8-5ca7806038d6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:22.931700 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a5b98644-770d-48a3-a7c8-5ca7806038d6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:22.938692 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a5b98644-770d-48a3-a7c8-5ca7806038d6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.939165 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a5b98644-770d-48a3-a7c8-5ca7806038d6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.939592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a5b98644-770d-48a3-a7c8-5ca7806038d6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:22.940271 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a5b98644-770d-48a3-a7c8-5ca7806038d6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:22.940717 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a5b98644-770d-48a3-a7c8-5ca7806038d6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:22.941162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a5b98644-770d-48a3-a7c8-5ca7806038d6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.068782 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a5b98644-770d-48a3-a7c8-5ca7806038d6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:23.076342 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a5b98644-770d-48a3-a7c8-5ca7806038d6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1557 microversion: 2.1 time: 0.149129 Aug 24 10:19:23.077060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 166/331] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:22 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:23.091376 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-43847de3-2fe1-4c7b-aaba-4c988ca4089b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:23.092019 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-43847de3-2fe1-4c7b-aaba-4c988ca4089b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:23.097226 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-37d87bff-ca3e-45b3-9c7a-6fb41d4ff785 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:23.097719 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-37d87bff-ca3e-45b3-9c7a-6fb41d4ff785 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:23.099384 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-43847de3-2fe1-4c7b-aaba-4c988ca4089b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.099758 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:23.099858 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-43847de3-2fe1-4c7b-aaba-4c988ca4089b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.100284 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-43847de3-2fe1-4c7b-aaba-4c988ca4089b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.101002 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-43847de3-2fe1-4c7b-aaba-4c988ca4089b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.101452 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-43847de3-2fe1-4c7b-aaba-4c988ca4089b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.101868 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-43847de3-2fe1-4c7b-aaba-4c988ca4089b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.104391 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d87bff-ca3e-45b3-9c7a-6fb41d4ff785 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.104893 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d87bff-ca3e-45b3-9c7a-6fb41d4ff785 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.105333 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d87bff-ca3e-45b3-9c7a-6fb41d4ff785 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.106028 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d87bff-ca3e-45b3-9c7a-6fb41d4ff785 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.106472 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d87bff-ca3e-45b3-9c7a-6fb41d4ff785 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.106898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d87bff-ca3e-45b3-9c7a-6fb41d4ff785 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.188614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-37d87bff-ca3e-45b3-9c7a-6fb41d4ff785 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096258 Aug 24 10:19:23.189571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 167/332] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Aug 24 10:19:23 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:23.238855 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-43847de3-2fe1-4c7b-aaba-4c988ca4089b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:23.247311 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-43847de3-2fe1-4c7b-aaba-4c988ca4089b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.160011 Aug 24 10:19:23.247893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 166/333] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:23 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:23.329700 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-995a102d-9136-42d9-a68e-76f8b39e2afd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:23.330338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-995a102d-9136-42d9-a68e-76f8b39e2afd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:23.337003 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995a102d-9136-42d9-a68e-76f8b39e2afd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.337565 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995a102d-9136-42d9-a68e-76f8b39e2afd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.338055 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995a102d-9136-42d9-a68e-76f8b39e2afd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.338829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995a102d-9136-42d9-a68e-76f8b39e2afd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.339346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995a102d-9136-42d9-a68e-76f8b39e2afd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.339830 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995a102d-9136-42d9-a68e-76f8b39e2afd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.344567 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:23.582669 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-83211d42-b782-4c8b-9534-80a7e21c85cf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:23.583260 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-83211d42-b782-4c8b-9534-80a7e21c85cf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:23.589292 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-83211d42-b782-4c8b-9534-80a7e21c85cf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.589766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-83211d42-b782-4c8b-9534-80a7e21c85cf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.590252 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-83211d42-b782-4c8b-9534-80a7e21c85cf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.590946 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-83211d42-b782-4c8b-9534-80a7e21c85cf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:23.591404 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-83211d42-b782-4c8b-9534-80a7e21c85cf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:23.591822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-83211d42-b782-4c8b-9534-80a7e21c85cf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:23.641591 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-995a102d-9136-42d9-a68e-76f8b39e2afd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:23.657184 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-83211d42-b782-4c8b-9534-80a7e21c85cf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:23.666552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-995a102d-9136-42d9-a68e-76f8b39e2afd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1370 microversion: 2.1 time: 0.328477 Aug 24 10:19:23.667002 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-83211d42-b782-4c8b-9534-80a7e21c85cf tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1274 microversion: 2.1 time: 0.088129 Aug 24 10:19:23.680378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 168/334] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:23 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1370 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:23.680599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 167/335] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:23 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:24.271443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3e46ba62-112d-4492-87cd-47a89679e5bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:24.272680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3e46ba62-112d-4492-87cd-47a89679e5bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:24.278965 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3e46ba62-112d-4492-87cd-47a89679e5bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.279456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3e46ba62-112d-4492-87cd-47a89679e5bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.280031 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3e46ba62-112d-4492-87cd-47a89679e5bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.281032 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3e46ba62-112d-4492-87cd-47a89679e5bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.281301 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3e46ba62-112d-4492-87cd-47a89679e5bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.282016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3e46ba62-112d-4492-87cd-47a89679e5bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.558577 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3e46ba62-112d-4492-87cd-47a89679e5bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:24.569297 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-753930a3-b21a-4581-aaed-a4ba5e071b18 req-726bee67-bf06-4f85-bca1-4497df709ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a33b6e4-dee4-4e74-9125-2023095d167a", "tag": "4b428aa4-0631-4aa6-82a7-97e1e11db86e"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:24.579476 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3e46ba62-112d-4492-87cd-47a89679e5bd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.314231 Aug 24 10:19:24.580065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 169/336] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:24 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:24.584203 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-753930a3-b21a-4581-aaed-a4ba5e071b18 req-726bee67-bf06-4f85-bca1-4497df709ebf service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.584970 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-753930a3-b21a-4581-aaed-a4ba5e071b18 req-726bee67-bf06-4f85-bca1-4497df709ebf service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.585599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-753930a3-b21a-4581-aaed-a4ba5e071b18 req-726bee67-bf06-4f85-bca1-4497df709ebf service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.598343 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-753930a3-b21a-4581-aaed-a4ba5e071b18 req-726bee67-bf06-4f85-bca1-4497df709ebf service nova] Creating event network-changed:4b428aa4-0631-4aa6-82a7-97e1e11db86e for instance 4a33b6e4-dee4-4e74-9125-2023095d167a on hv-cinder-85427 Aug 24 10:19:24.603179 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-753930a3-b21a-4581-aaed-a4ba5e071b18 req-726bee67-bf06-4f85-bca1-4497df709ebf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037750 Aug 24 10:19:24.603789 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 168/337] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:24.693638 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6a0aff3e-d29a-468e-8282-f97dba1006f4 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:24.694652 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-6a0aff3e-d29a-468e-8282-f97dba1006f4 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:24.698689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7e1bc521-dbe6-4fad-bfac-eefc4c8bb07d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:24.699311 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7e1bc521-dbe6-4fad-bfac-eefc4c8bb07d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:24.710512 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e1bc521-dbe6-4fad-bfac-eefc4c8bb07d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.710998 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e1bc521-dbe6-4fad-bfac-eefc4c8bb07d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.711462 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e1bc521-dbe6-4fad-bfac-eefc4c8bb07d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.712289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e1bc521-dbe6-4fad-bfac-eefc4c8bb07d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.712841 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e1bc521-dbe6-4fad-bfac-eefc4c8bb07d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.713295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e1bc521-dbe6-4fad-bfac-eefc4c8bb07d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.717353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a0aff3e-d29a-468e-8282-f97dba1006f4 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.718256 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a0aff3e-d29a-468e-8282-f97dba1006f4 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.719536 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a0aff3e-d29a-468e-8282-f97dba1006f4 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.720283 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a0aff3e-d29a-468e-8282-f97dba1006f4 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:24.720748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a0aff3e-d29a-468e-8282-f97dba1006f4 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:24.721204 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6a0aff3e-d29a-468e-8282-f97dba1006f4 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:24.799975 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6a0aff3e-d29a-468e-8282-f97dba1006f4 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:24.809686 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-6a0aff3e-d29a-468e-8282-f97dba1006f4 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1272 microversion: 2.1 time: 0.122874 Aug 24 10:19:24.811281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 169/338] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:24 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:25.300494 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7e1bc521-dbe6-4fad-bfac-eefc4c8bb07d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:25.309370 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7e1bc521-dbe6-4fad-bfac-eefc4c8bb07d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1565 microversion: 2.1 time: 0.624161 Aug 24 10:19:25.325238 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 170/339] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:24 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1565 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:25.332577 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-20fb1248-2985-4ac3-b616-0a06a41a1c0c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:25.332577 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-20fb1248-2985-4ac3-b616-0a06a41a1c0c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:25.342093 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20fb1248-2985-4ac3-b616-0a06a41a1c0c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.342093 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20fb1248-2985-4ac3-b616-0a06a41a1c0c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.342093 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20fb1248-2985-4ac3-b616-0a06a41a1c0c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:25.342093 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20fb1248-2985-4ac3-b616-0a06a41a1c0c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.342556 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20fb1248-2985-4ac3-b616-0a06a41a1c0c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.342556 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-20fb1248-2985-4ac3-b616-0a06a41a1c0c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:25.430427 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-20fb1248-2985-4ac3-b616-0a06a41a1c0c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103249 Aug 24 10:19:25.432902 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 170/340] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Aug 24 10:19:25 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:25.603186 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-47ccc38d-9b65-447a-90f0-289e10e960ff tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:25.609774 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-47ccc38d-9b65-447a-90f0-289e10e960ff tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:25.612243 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47ccc38d-9b65-447a-90f0-289e10e960ff tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.612733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47ccc38d-9b65-447a-90f0-289e10e960ff tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.613522 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47ccc38d-9b65-447a-90f0-289e10e960ff tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:25.614792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47ccc38d-9b65-447a-90f0-289e10e960ff tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.615560 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47ccc38d-9b65-447a-90f0-289e10e960ff tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.616138 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47ccc38d-9b65-447a-90f0-289e10e960ff tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:25.832524 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-864ded61-de0f-4f1a-9976-0f2112bd4b63 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:25.833218 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-864ded61-de0f-4f1a-9976-0f2112bd4b63 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:25.840238 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-864ded61-de0f-4f1a-9976-0f2112bd4b63 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.841488 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-864ded61-de0f-4f1a-9976-0f2112bd4b63 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.842120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-864ded61-de0f-4f1a-9976-0f2112bd4b63 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:25.842982 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-864ded61-de0f-4f1a-9976-0f2112bd4b63 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:25.844290 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-864ded61-de0f-4f1a-9976-0f2112bd4b63 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:25.844997 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-864ded61-de0f-4f1a-9976-0f2112bd4b63 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:25.990273 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-47ccc38d-9b65-447a-90f0-289e10e960ff tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:26.007886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-47ccc38d-9b65-447a-90f0-289e10e960ff tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.410373 Aug 24 10:19:26.008686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 171/341] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:25 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:26.052456 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-864ded61-de0f-4f1a-9976-0f2112bd4b63 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:26.059998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-864ded61-de0f-4f1a-9976-0f2112bd4b63 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1314 microversion: 2.1 time: 0.232370 Aug 24 10:19:26.060562 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 171/342] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:25 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:26.511825 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-6fd42093-0d3e-4340-bce0-bfae3605131f req-cc5539ec-21c1-47fe-9378-97d16b3ff321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa35bff-3f3e-4a84-af4f-cdb62e5a4481", "tag": "50a4db0b-fe10-4ecc-9fab-c39a1162c94a"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:26.522394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-6fd42093-0d3e-4340-bce0-bfae3605131f req-cc5539ec-21c1-47fe-9378-97d16b3ff321 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:26.522936 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-6fd42093-0d3e-4340-bce0-bfae3605131f req-cc5539ec-21c1-47fe-9378-97d16b3ff321 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:26.523424 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-6fd42093-0d3e-4340-bce0-bfae3605131f req-cc5539ec-21c1-47fe-9378-97d16b3ff321 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:26.535402 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-6fd42093-0d3e-4340-bce0-bfae3605131f req-cc5539ec-21c1-47fe-9378-97d16b3ff321 service nova] Creating event network-changed:50a4db0b-fe10-4ecc-9fab-c39a1162c94a for instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 on hv-cinder-85427 Aug 24 10:19:26.540426 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-6fd42093-0d3e-4340-bce0-bfae3605131f req-cc5539ec-21c1-47fe-9378-97d16b3ff321 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032261 Aug 24 10:19:26.545530 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 172/343] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:26.973776 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-f8321b5c-ea48-4614-b902-0c6bb21db2f1 req-1d893405-6452-4a86-8da8-96106dc471df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b", "tag": "e56cc9ce-bc3d-4b42-a646-c52b9da3d2f3"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:26.987177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f8321b5c-ea48-4614-b902-0c6bb21db2f1 req-1d893405-6452-4a86-8da8-96106dc471df service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:26.987669 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f8321b5c-ea48-4614-b902-0c6bb21db2f1 req-1d893405-6452-4a86-8da8-96106dc471df service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:26.988155 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f8321b5c-ea48-4614-b902-0c6bb21db2f1 req-1d893405-6452-4a86-8da8-96106dc471df service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.002297 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-f8321b5c-ea48-4614-b902-0c6bb21db2f1 req-1d893405-6452-4a86-8da8-96106dc471df service nova] Creating event network-changed:e56cc9ce-bc3d-4b42-a646-c52b9da3d2f3 for instance d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b on hv-cinder-85427 Aug 24 10:19:27.007929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-f8321b5c-ea48-4614-b902-0c6bb21db2f1 req-1d893405-6452-4a86-8da8-96106dc471df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038120 Aug 24 10:19:27.008535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 172/344] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:27.030456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-34573a95-f963-4a7b-a753-b82d1b9663fb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:27.031858 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-34573a95-f963-4a7b-a753-b82d1b9663fb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:27.038691 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-34573a95-f963-4a7b-a753-b82d1b9663fb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:27.039360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-34573a95-f963-4a7b-a753-b82d1b9663fb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:27.039886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-34573a95-f963-4a7b-a753-b82d1b9663fb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.040682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-34573a95-f963-4a7b-a753-b82d1b9663fb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:27.041282 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-34573a95-f963-4a7b-a753-b82d1b9663fb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:27.041796 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-34573a95-f963-4a7b-a753-b82d1b9663fb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.082071 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-26dcf12c-1f67-4352-932a-39459dd65234 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:27.082789 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-26dcf12c-1f67-4352-932a-39459dd65234 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:27.089284 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26dcf12c-1f67-4352-932a-39459dd65234 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:27.090543 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26dcf12c-1f67-4352-932a-39459dd65234 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:27.090988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26dcf12c-1f67-4352-932a-39459dd65234 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.091997 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26dcf12c-1f67-4352-932a-39459dd65234 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:27.092635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26dcf12c-1f67-4352-932a-39459dd65234 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:27.094432 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26dcf12c-1f67-4352-932a-39459dd65234 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:27.242253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-26dcf12c-1f67-4352-932a-39459dd65234 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:27.257181 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-26dcf12c-1f67-4352-932a-39459dd65234 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1314 microversion: 2.1 time: 0.180367 Aug 24 10:19:27.257791 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 173/345] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:27 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:27.357217 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-34573a95-f963-4a7b-a753-b82d1b9663fb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:27.366157 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-34573a95-f963-4a7b-a753-b82d1b9663fb tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1723 microversion: 2.1 time: 0.340802 Aug 24 10:19:27.379890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 173/346] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:27 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:28.277744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9293e2d9-bab2-47c7-bf32-ff26f1bd2590 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:28.278358 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9293e2d9-bab2-47c7-bf32-ff26f1bd2590 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:28.285677 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9293e2d9-bab2-47c7-bf32-ff26f1bd2590 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.286216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9293e2d9-bab2-47c7-bf32-ff26f1bd2590 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.286659 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9293e2d9-bab2-47c7-bf32-ff26f1bd2590 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.287347 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9293e2d9-bab2-47c7-bf32-ff26f1bd2590 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.287804 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9293e2d9-bab2-47c7-bf32-ff26f1bd2590 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.288230 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9293e2d9-bab2-47c7-bf32-ff26f1bd2590 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.292357 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=100 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:28.387684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-995273fb-d07b-47a2-a6b4-d78de4787853 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:28.388684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-995273fb-d07b-47a2-a6b4-d78de4787853 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:28.395507 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995273fb-d07b-47a2-a6b4-d78de4787853 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.395997 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995273fb-d07b-47a2-a6b4-d78de4787853 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.396437 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995273fb-d07b-47a2-a6b4-d78de4787853 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.397208 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995273fb-d07b-47a2-a6b4-d78de4787853 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.397706 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995273fb-d07b-47a2-a6b4-d78de4787853 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.398150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-995273fb-d07b-47a2-a6b4-d78de4787853 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.418876 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9293e2d9-bab2-47c7-bf32-ff26f1bd2590 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:28.427578 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9293e2d9-bab2-47c7-bf32-ff26f1bd2590 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1314 microversion: 2.1 time: 0.153793 Aug 24 10:19:28.428176 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 174/347] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:28 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:28.529811 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-995273fb-d07b-47a2-a6b4-d78de4787853 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:28.538220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-995273fb-d07b-47a2-a6b4-d78de4787853 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1700 microversion: 2.1 time: 0.154573 Aug 24 10:19:28.538787 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 174/348] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:28 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:19:28.558712 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-21883d52-720c-4c3f-b089-8dd5a69414c4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:28.564724 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21883d52-720c-4c3f-b089-8dd5a69414c4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.565240 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21883d52-720c-4c3f-b089-8dd5a69414c4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.565673 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21883d52-720c-4c3f-b089-8dd5a69414c4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.587235 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-21883d52-720c-4c3f-b089-8dd5a69414c4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Going to try to start instance {{(pid=121271) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 10:19:28.757797 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-21883d52-720c-4c3f-b089-8dd5a69414c4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/action" status: 202 len: 0 microversion: 2.1 time: 0.202791 Aug 24 10:19:28.758393 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 175/349] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:19:28 2022] POST /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:19:28.767092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5a861562-da07-47bc-9533-203b2d9d4ced tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:28.767723 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5a861562-da07-47bc-9533-203b2d9d4ced tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:28.773724 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5a861562-da07-47bc-9533-203b2d9d4ced tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.774231 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5a861562-da07-47bc-9533-203b2d9d4ced tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.774641 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5a861562-da07-47bc-9533-203b2d9d4ced tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.775357 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5a861562-da07-47bc-9533-203b2d9d4ced tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:28.775810 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5a861562-da07-47bc-9533-203b2d9d4ced tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:28.776238 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5a861562-da07-47bc-9533-203b2d9d4ced tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:28.902091 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5a861562-da07-47bc-9533-203b2d9d4ced tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:28.910378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5a861562-da07-47bc-9533-203b2d9d4ced tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1709 microversion: 2.1 time: 0.147789 Aug 24 10:19:28.910935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 175/350] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:28 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1709 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:29.445840 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:29.446608 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=6 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:29.451067 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-68854148-164f-45dd-9e0d-8e40723f592a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.451777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-68854148-164f-45dd-9e0d-8e40723f592a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:29.458244 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68854148-164f-45dd-9e0d-8e40723f592a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:29.458727 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68854148-164f-45dd-9e0d-8e40723f592a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:29.459160 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68854148-164f-45dd-9e0d-8e40723f592a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:29.459846 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68854148-164f-45dd-9e0d-8e40723f592a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:29.460298 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68854148-164f-45dd-9e0d-8e40723f592a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:29.460720 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68854148-164f-45dd-9e0d-8e40723f592a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:29.599005 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-68854148-164f-45dd-9e0d-8e40723f592a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:29.608956 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-68854148-164f-45dd-9e0d-8e40723f592a tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1314 microversion: 2.1 time: 0.163975 Aug 24 10:19:29.612914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 176/351] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:29.930890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9f35b82e-4b2a-413e-a15b-1d4df34d148a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:29.932307 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9f35b82e-4b2a-413e-a15b-1d4df34d148a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:29.934365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:29.940145 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f35b82e-4b2a-413e-a15b-1d4df34d148a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:29.940608 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f35b82e-4b2a-413e-a15b-1d4df34d148a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:29.941090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f35b82e-4b2a-413e-a15b-1d4df34d148a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:29.942233 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f35b82e-4b2a-413e-a15b-1d4df34d148a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:29.942233 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f35b82e-4b2a-413e-a15b-1d4df34d148a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:29.942634 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f35b82e-4b2a-413e-a15b-1d4df34d148a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:30.130566 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9f35b82e-4b2a-413e-a15b-1d4df34d148a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:30.139156 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9f35b82e-4b2a-413e-a15b-1d4df34d148a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1709 microversion: 2.1 time: 0.212087 Aug 24 10:19:30.139735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 176/352] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:29 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1709 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:30.631147 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-61281e32-27f6-44c1-8ee7-bfa0868597df tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:30.631964 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-61281e32-27f6-44c1-8ee7-bfa0868597df tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:30.638155 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61281e32-27f6-44c1-8ee7-bfa0868597df tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:30.638690 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61281e32-27f6-44c1-8ee7-bfa0868597df tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:30.639132 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61281e32-27f6-44c1-8ee7-bfa0868597df tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:30.639822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61281e32-27f6-44c1-8ee7-bfa0868597df tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:30.640281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61281e32-27f6-44c1-8ee7-bfa0868597df tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:30.640740 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61281e32-27f6-44c1-8ee7-bfa0868597df tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:30.775824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-61281e32-27f6-44c1-8ee7-bfa0868597df tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:30.784528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-61281e32-27f6-44c1-8ee7-bfa0868597df tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1314 microversion: 2.1 time: 0.157263 Aug 24 10:19:30.785147 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 177/353] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:30 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:31.160224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-fc4d51f4-3066-472a-b27d-3f202a984897 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:31.160777 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-fc4d51f4-3066-472a-b27d-3f202a984897 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:31.167117 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc4d51f4-3066-472a-b27d-3f202a984897 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.167588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc4d51f4-3066-472a-b27d-3f202a984897 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.168012 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc4d51f4-3066-472a-b27d-3f202a984897 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.168687 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc4d51f4-3066-472a-b27d-3f202a984897 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.169162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc4d51f4-3066-472a-b27d-3f202a984897 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.169576 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fc4d51f4-3066-472a-b27d-3f202a984897 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.297050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-fc4d51f4-3066-472a-b27d-3f202a984897 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:31.305311 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-fc4d51f4-3066-472a-b27d-3f202a984897 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1709 microversion: 2.1 time: 0.149013 Aug 24 10:19:31.305875 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 177/354] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:31 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:31.805292 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9c3091d7-c7a9-48a6-bec2-780729989883 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:31.805823 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9c3091d7-c7a9-48a6-bec2-780729989883 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:31.812801 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9c3091d7-c7a9-48a6-bec2-780729989883 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.813582 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9c3091d7-c7a9-48a6-bec2-780729989883 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.814305 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9c3091d7-c7a9-48a6-bec2-780729989883 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.814861 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9c3091d7-c7a9-48a6-bec2-780729989883 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:31.815777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9c3091d7-c7a9-48a6-bec2-780729989883 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:31.816210 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9c3091d7-c7a9-48a6-bec2-780729989883 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:31.945429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9c3091d7-c7a9-48a6-bec2-780729989883 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:31.953105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9c3091d7-c7a9-48a6-bec2-780729989883 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1314 microversion: 2.1 time: 0.151685 Aug 24 10:19:31.953670 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 178/355] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:31 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:32.326728 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ca320b57-71b8-480c-aa21-7edc727145c0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:32.327337 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ca320b57-71b8-480c-aa21-7edc727145c0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:32.334397 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ca320b57-71b8-480c-aa21-7edc727145c0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.334843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ca320b57-71b8-480c-aa21-7edc727145c0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.335268 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ca320b57-71b8-480c-aa21-7edc727145c0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.335945 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ca320b57-71b8-480c-aa21-7edc727145c0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.336390 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ca320b57-71b8-480c-aa21-7edc727145c0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.336803 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ca320b57-71b8-480c-aa21-7edc727145c0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.469271 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ca320b57-71b8-480c-aa21-7edc727145c0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:32.478062 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ca320b57-71b8-480c-aa21-7edc727145c0 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1713 microversion: 2.1 time: 0.155126 Aug 24 10:19:32.478668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 178/356] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:32 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:32.923712 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-f30041b8-ac2b-41c4-a1d6-1c17fa6d4372 req-8b7cf222-2b1e-4cec-89fa-16ede10f2aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b", "name": "network-vif-plugged", "status": "completed", "tag": "e56cc9ce-bc3d-4b42-a646-c52b9da3d2f3"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:32.933460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f30041b8-ac2b-41c4-a1d6-1c17fa6d4372 req-8b7cf222-2b1e-4cec-89fa-16ede10f2aaf service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.933930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f30041b8-ac2b-41c4-a1d6-1c17fa6d4372 req-8b7cf222-2b1e-4cec-89fa-16ede10f2aaf service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.934353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f30041b8-ac2b-41c4-a1d6-1c17fa6d4372 req-8b7cf222-2b1e-4cec-89fa-16ede10f2aaf service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.945689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-f30041b8-ac2b-41c4-a1d6-1c17fa6d4372 req-8b7cf222-2b1e-4cec-89fa-16ede10f2aaf service nova] Creating event network-vif-plugged:e56cc9ce-bc3d-4b42-a646-c52b9da3d2f3 for instance d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b on hv-cinder-85427 Aug 24 10:19:32.950682 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-f30041b8-ac2b-41c4-a1d6-1c17fa6d4372 req-8b7cf222-2b1e-4cec-89fa-16ede10f2aaf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031244 Aug 24 10:19:32.951282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 179/357] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:32.975248 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7b250d34-6005-474b-817b-414e44dcaf70 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:32.975895 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7b250d34-6005-474b-817b-414e44dcaf70 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:32.984618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b250d34-6005-474b-817b-414e44dcaf70 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.984618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b250d34-6005-474b-817b-414e44dcaf70 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.984618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b250d34-6005-474b-817b-414e44dcaf70 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:32.984618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b250d34-6005-474b-817b-414e44dcaf70 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:32.985172 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b250d34-6005-474b-817b-414e44dcaf70 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:32.985172 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b250d34-6005-474b-817b-414e44dcaf70 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:33.121178 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7b250d34-6005-474b-817b-414e44dcaf70 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:33.131791 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7b250d34-6005-474b-817b-414e44dcaf70 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1314 microversion: 2.1 time: 0.160071 Aug 24 10:19:33.133071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 179/358] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:32 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:34.155142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-261e7a63-f7d9-4c04-bfc3-19c0b276cb2f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:34.155846 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-261e7a63-f7d9-4c04-bfc3-19c0b276cb2f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:34.163259 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-261e7a63-f7d9-4c04-bfc3-19c0b276cb2f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:34.163820 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-261e7a63-f7d9-4c04-bfc3-19c0b276cb2f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:34.164260 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-261e7a63-f7d9-4c04-bfc3-19c0b276cb2f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:34.164984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-261e7a63-f7d9-4c04-bfc3-19c0b276cb2f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:34.165444 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-261e7a63-f7d9-4c04-bfc3-19c0b276cb2f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:34.165875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-261e7a63-f7d9-4c04-bfc3-19c0b276cb2f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:34.299131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-261e7a63-f7d9-4c04-bfc3-19c0b276cb2f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:34.306871 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-261e7a63-f7d9-4c04-bfc3-19c0b276cb2f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1314 microversion: 2.1 time: 0.156078 Aug 24 10:19:34.307438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 180/359] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:34 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:35.327593 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b684a6c0-c9af-4ed2-8e28-4bf771744487 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:35.328240 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b684a6c0-c9af-4ed2-8e28-4bf771744487 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:35.335948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b684a6c0-c9af-4ed2-8e28-4bf771744487 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:35.336435 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b684a6c0-c9af-4ed2-8e28-4bf771744487 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:35.336888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b684a6c0-c9af-4ed2-8e28-4bf771744487 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:35.337587 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b684a6c0-c9af-4ed2-8e28-4bf771744487 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:35.338040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b684a6c0-c9af-4ed2-8e28-4bf771744487 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:35.338466 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b684a6c0-c9af-4ed2-8e28-4bf771744487 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:35.468733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b684a6c0-c9af-4ed2-8e28-4bf771744487 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:35.477311 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b684a6c0-c9af-4ed2-8e28-4bf771744487 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1314 microversion: 2.1 time: 0.153530 Aug 24 10:19:35.477899 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 180/360] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:35 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:36.498187 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3248688f-0012-49b7-93da-8b2155cc0981 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:36.498795 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3248688f-0012-49b7-93da-8b2155cc0981 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:36.505867 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3248688f-0012-49b7-93da-8b2155cc0981 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:36.506340 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3248688f-0012-49b7-93da-8b2155cc0981 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:36.506773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3248688f-0012-49b7-93da-8b2155cc0981 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:36.507453 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3248688f-0012-49b7-93da-8b2155cc0981 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:36.507899 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3248688f-0012-49b7-93da-8b2155cc0981 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:36.508313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3248688f-0012-49b7-93da-8b2155cc0981 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:36.637152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3248688f-0012-49b7-93da-8b2155cc0981 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:36.646663 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3248688f-0012-49b7-93da-8b2155cc0981 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1498 microversion: 2.1 time: 0.152280 Aug 24 10:19:36.647239 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 181/361] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:36 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:37.572743 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6e5cff3c-ad58-494d-8d67-cf50a1d004e3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:37.573314 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6e5cff3c-ad58-494d-8d67-cf50a1d004e3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:37.579835 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e5cff3c-ad58-494d-8d67-cf50a1d004e3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.580314 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e5cff3c-ad58-494d-8d67-cf50a1d004e3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.581113 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e5cff3c-ad58-494d-8d67-cf50a1d004e3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:37.581503 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e5cff3c-ad58-494d-8d67-cf50a1d004e3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.581959 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e5cff3c-ad58-494d-8d67-cf50a1d004e3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.582385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e5cff3c-ad58-494d-8d67-cf50a1d004e3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:37.609544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6e5cff3c-ad58-494d-8d67-cf50a1d004e3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Going to try to terminate instance {{(pid=121270) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:19:37.943736 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6e5cff3c-ad58-494d-8d67-cf50a1d004e3 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 204 len: 0 microversion: 2.1 time: 0.374593 Aug 24 10:19:37.944537 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 181/362] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:19:37 2022] DELETE /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:37.952434 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e0aebed2-c249-4568-9380-2a877841dc4f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:37.953079 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e0aebed2-c249-4568-9380-2a877841dc4f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:37.959402 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0aebed2-c249-4568-9380-2a877841dc4f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.959877 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0aebed2-c249-4568-9380-2a877841dc4f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.960310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0aebed2-c249-4568-9380-2a877841dc4f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:37.961033 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0aebed2-c249-4568-9380-2a877841dc4f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:37.961485 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0aebed2-c249-4568-9380-2a877841dc4f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:37.961906 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0aebed2-c249-4568-9380-2a877841dc4f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:38.093662 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e0aebed2-c249-4568-9380-2a877841dc4f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:38.102484 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e0aebed2-c249-4568-9380-2a877841dc4f tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1504 microversion: 2.1 time: 0.153522 Aug 24 10:19:38.103137 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 182/363] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:37 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:38.775006 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-60bd0770-a54b-43f6-a596-9e23ecbbcfd2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:38.775582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-60bd0770-a54b-43f6-a596-9e23ecbbcfd2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:38.782174 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60bd0770-a54b-43f6-a596-9e23ecbbcfd2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:38.782655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60bd0770-a54b-43f6-a596-9e23ecbbcfd2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:38.783089 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60bd0770-a54b-43f6-a596-9e23ecbbcfd2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:38.783915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60bd0770-a54b-43f6-a596-9e23ecbbcfd2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:38.784321 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60bd0770-a54b-43f6-a596-9e23ecbbcfd2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:38.784744 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60bd0770-a54b-43f6-a596-9e23ecbbcfd2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:38.807344 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-60bd0770-a54b-43f6-a596-9e23ecbbcfd2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/ips" status: 200 len: 152 microversion: 2.20 time: 0.036582 Aug 24 10:19:38.807910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 182/364] 10.222.0.30 () {60 vars in 1289 bytes} [Wed Aug 24 10:19:38 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:19:39.124975 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-96e79f52-cfd3-4f85-a0cd-56a91a463d80 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:39.125597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-96e79f52-cfd3-4f85-a0cd-56a91a463d80 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:39.132784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96e79f52-cfd3-4f85-a0cd-56a91a463d80 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:39.142658 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96e79f52-cfd3-4f85-a0cd-56a91a463d80 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:39.142658 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96e79f52-cfd3-4f85-a0cd-56a91a463d80 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:39.142658 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96e79f52-cfd3-4f85-a0cd-56a91a463d80 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:39.142658 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96e79f52-cfd3-4f85-a0cd-56a91a463d80 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:39.143077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-96e79f52-cfd3-4f85-a0cd-56a91a463d80 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:39.287224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-96e79f52-cfd3-4f85-a0cd-56a91a463d80 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:39.294997 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-96e79f52-cfd3-4f85-a0cd-56a91a463d80 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1504 microversion: 2.1 time: 0.173991 Aug 24 10:19:39.295579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 183/365] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:39 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:40.316111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-897c4589-1adb-41a6-abbe-6e2487a671ea tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:40.317844 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-897c4589-1adb-41a6-abbe-6e2487a671ea tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:40.323184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-897c4589-1adb-41a6-abbe-6e2487a671ea tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:40.323729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-897c4589-1adb-41a6-abbe-6e2487a671ea tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:40.324165 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-897c4589-1adb-41a6-abbe-6e2487a671ea tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:40.324881 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-897c4589-1adb-41a6-abbe-6e2487a671ea tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:40.325362 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-897c4589-1adb-41a6-abbe-6e2487a671ea tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:40.325791 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-897c4589-1adb-41a6-abbe-6e2487a671ea tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:40.416498 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-897c4589-1adb-41a6-abbe-6e2487a671ea tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:40.425972 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-897c4589-1adb-41a6-abbe-6e2487a671ea tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1462 microversion: 2.1 time: 0.113739 Aug 24 10:19:40.426869 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 183/366] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:40 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1462 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:40.482914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-add32f8e-cfde-466d-9d39-fdbcad22ea3f req-e228b5bc-341d-4478-a385-6de3d60de668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b", "name": "network-vif-deleted", "tag": "e56cc9ce-bc3d-4b42-a646-c52b9da3d2f3"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:40.492777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-add32f8e-cfde-466d-9d39-fdbcad22ea3f req-e228b5bc-341d-4478-a385-6de3d60de668 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:40.493219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-add32f8e-cfde-466d-9d39-fdbcad22ea3f req-e228b5bc-341d-4478-a385-6de3d60de668 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:40.493654 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-add32f8e-cfde-466d-9d39-fdbcad22ea3f req-e228b5bc-341d-4478-a385-6de3d60de668 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:40.504773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-add32f8e-cfde-466d-9d39-fdbcad22ea3f req-e228b5bc-341d-4478-a385-6de3d60de668 service nova] Creating event network-vif-deleted:e56cc9ce-bc3d-4b42-a646-c52b9da3d2f3 for instance d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b on hv-cinder-85427 Aug 24 10:19:40.509990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-add32f8e-cfde-466d-9d39-fdbcad22ea3f req-e228b5bc-341d-4478-a385-6de3d60de668 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030864 Aug 24 10:19:40.510586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 184/367] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:19:41.446969 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:41.447748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:41.454326 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:41.455113 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:41.455558 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:41.456253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:41.456705 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:41.457155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:41.461371 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:41.488293 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:41.488772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:41.489555 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:41.489950 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lazy-loading 'fault' on Instance uuid d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:19:41.535664 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dff7bd7a1a3f48b696c0e36a6d15757a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd097a59291481ab5cd35689765e9bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:41.543570 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c80da963-89ae-447b-acb6-fc3976701f5d tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 200 len: 1304 microversion: 2.1 time: 0.100393 Aug 24 10:19:41.544131 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 184/368] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:41 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:19:42.040477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-64ed7bd6-96f4-401a-a850-00ff2f8ebe7c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:19:42.041119 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-64ed7bd6-96f4-401a-a850-00ff2f8ebe7c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:42.047683 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64ed7bd6-96f4-401a-a850-00ff2f8ebe7c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.048177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64ed7bd6-96f4-401a-a850-00ff2f8ebe7c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.048939 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64ed7bd6-96f4-401a-a850-00ff2f8ebe7c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:42.049646 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64ed7bd6-96f4-401a-a850-00ff2f8ebe7c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.050102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64ed7bd6-96f4-401a-a850-00ff2f8ebe7c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.050529 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64ed7bd6-96f4-401a-a850-00ff2f8ebe7c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:42.072650 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-64ed7bd6-96f4-401a-a850-00ff2f8ebe7c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lazy-loading 'flavor' on Instance uuid ac36f3b6-c66c-406b-b472-0a2dd018d4c3 {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:19:42.566875 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:42.567502 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] [instance: d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:42.574509 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.575089 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.575531 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:42.576257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.576713 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.577219 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:42.592307 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] HTTP exception thrown: Instance d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b could not be found. Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Request method failure captured: Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b HTTP/1.1 Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfsNYbRnoDeMUfoxS3d61hiZjlFraqgvHum00WmmKdsEhv7_Z9D_lBLE_NYQ3I6BEeU8elVLUn1k-l05PaPnKLgu8y9RrjolNXdm31fSrS_Pv-6SH-X3ecZcWvjleqF6fid3vV_AGZF4HBzBbj6nHC7A9J3BZwtWcblUKhOtFf_38EE Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 5cd097a59291481ab5cd35689765e9bc Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-VolumesActionsTest-2107266854 Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:19:42.594128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5cd097a59291481ab5cd35689765e9bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5cd097a59291481ab5cd35689765e9bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5cd097a59291481ab5cd35689765e9bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5cd097a59291481ab5cd35689765e9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-VolumesActionsTest-2107266854 Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 5cd097a59291481ab5cd35689765e9bc Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-VolumesActionsTest-2107266854 Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-VolumesActionsTest-2107266854-project Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: dff7bd7a1a3f48b696c0e36a6d15757a Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-VolumesActionsTest-2107266854-project Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b could not be found. Aug 24 10:19:42.595614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': 'd4ddf1ef-fda5-46c6-a4a8-a20db865ba9b'} Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b could not be found. Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:19:42.596792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b could not be found. Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b could not be found. Aug 24 10:19:42.598249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:19:42.599246 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] Returning 404 to user: Instance d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:19:42.599246 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-04ad1a07-5a7c-465d-a28a-115cc1d99fb6 tempest-VolumesActionsTest-2107266854 tempest-VolumesActionsTest-2107266854-project] 10.222.0.30 "GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b" status: 404 len: 111 microversion: 2.1 time: 0.033633 Aug 24 10:19:42.599246 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 185/369] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:19:42 2022] GET /compute/v2.1/servers/d4ddf1ef-fda5-46c6-a4a8-a20db865ba9b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:19:42.642027 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-64ed7bd6-96f4-401a-a850-00ff2f8ebe7c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "POST /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/action" status: 202 len: 0 microversion: 2.20 time: 0.605238 Aug 24 10:19:42.642621 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 185/370] 10.222.0.30 () {62 vars in 1319 bytes} [Wed Aug 24 10:19:42 2022] POST /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:19:42.651847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:42.652460 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:42.659297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.661278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.661278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:42.661278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:42.661665 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:42.662100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:42.797825 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:42.808346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:42.810100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:42.811349 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4959f6bb-6997-4546-816f-c480f1b3d181 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.163703 Aug 24 10:19:42.819051 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 186/371] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:42 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:43.839648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:43.840347 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:43.848108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:43.848606 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:43.849232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:43.849958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:43.850431 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:43.850852 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:43.985078 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:43.994636 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:43.996335 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:43.997683 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4d260964-4bc5-4b9b-acf9-d6fea82fc3da tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.163017 Aug 24 10:19:44.004222 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 186/372] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:43 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:45.025439 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:45.026052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:45.032604 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:45.033124 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:45.033559 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:45.034273 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:45.034805 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:45.035211 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:45.168052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:45.177110 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:45.178657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:45.179856 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d0cd6c1b-ed79-443c-91f6-88adc191a1fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.158477 Aug 24 10:19:45.180447 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 187/373] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:45 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:46.203972 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:46.204587 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:46.211861 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:46.212341 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:46.212773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:46.213491 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:46.213943 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:46.214368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:46.350627 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:46.358820 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:46.360349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:46.361549 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-6e245a24-5db1-42a1-9279-7d81c0398fb9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.161741 Aug 24 10:19:46.362115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 187/374] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:46 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:47.384947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:47.385557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:47.391900 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:47.392389 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:47.392846 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:47.393552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:47.394052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:47.394473 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:47.525526 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:47.533603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:47.535212 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:47.536388 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-be2d2eb6-1c30-42ed-9c0c-cd8e785f415f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.155332 Aug 24 10:19:47.536944 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 188/375] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:47 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:48.563842 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:48.565109 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:48.577892 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:48.580018 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:48.580472 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:48.582539 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:48.583655 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:48.584285 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:48.743407 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:48.751836 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:48.753445 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:48.755550 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-64625ca1-3018-41fd-951d-0806783e6f36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.199460 Aug 24 10:19:48.756702 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 188/376] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:48 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:49.789911 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:49.790657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:49.804534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:49.805157 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:49.805782 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:49.806557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:49.807140 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:49.807600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:50.035148 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:50.043579 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:50.045051 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:50.046218 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-305ae686-c6df-400d-8862-7ec1457eb66d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.263945 Aug 24 10:19:50.047115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 189/377] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:49 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:51.078765 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:51.079376 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:51.081911 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:51.087888 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:51.088317 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:51.088795 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:51.089571 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:51.090047 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:51.090481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:51.094512 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:51.231404 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:51.242069 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:51.245026 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:51.246483 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f888d6a2-54ee-4f35-8eac-d5956b5952e5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.171559 Aug 24 10:19:51.247398 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 189/378] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:51 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:52.277285 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:52.278408 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:52.289212 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:52.289818 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:52.290846 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:52.292334 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:52.293208 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:52.294165 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:52.472789 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:52.482526 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:52.484043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:52.487816 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cc823bbf-b26d-46bb-b3ab-82dee205f02c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.217977 Aug 24 10:19:52.488419 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 190/379] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:52 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:53.513612 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:53.514978 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:53.525060 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.525831 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.526635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.527796 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:53.528640 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:53.529450 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:53.694185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:53.703372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:53.704955 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:53.706180 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c49a844a-ed24-4788-83bc-684c09fbf8be tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.198946 Aug 24 10:19:53.706988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 190/380] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:53 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:54.732619 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:54.734562 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:54.745712 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:19:54.748041 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:54.748977 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:54.749504 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:54.751097 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:54.752227 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:54.752796 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:54.937682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:54.948036 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:54.952356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:54.952356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9c41144a-7219-4708-840a-680f651ec50b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.225106 Aug 24 10:19:54.952356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 191/381] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:54 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:55.975699 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:55.976300 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:55.983375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:55.983916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:55.984416 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:55.985209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:55.985715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:55.986296 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:56.136215 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:56.137511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:56.139078 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:56.140628 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2324c455-d58d-471c-9e2a-a30e9c2dcc86 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.168787 Aug 24 10:19:56.157715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 191/382] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:55 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:57.165950 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:57.166602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:57.179655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:57.180390 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:57.181024 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:57.181725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:57.182164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:57.182740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:57.346734 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:57.355398 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:57.356704 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:57.357917 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-150c3256-3d41-4fd3-b6bc-aa18fec15bb7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.196718 Aug 24 10:19:57.358922 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 192/383] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:57 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:19:58.381065 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:58.383093 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:58.388412 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:58.388928 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:58.389408 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:58.390075 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:58.390569 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:58.390937 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:58.533004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:58.543207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:58.544808 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:58.546105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-efa195eb-cd77-4ee8-ac06-9ffb2b49217e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.169739 Aug 24 10:19:58.546953 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 192/384] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:58 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:19:59.571071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:19:59.572003 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:19:59.590671 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:59.591252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:59.591746 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:59.592524 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:19:59.593238 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:19:59.594004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:19:59.833165 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:59.851789 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:59.860625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:19:59.866527 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-58ff12d4-a879-4b74-b79b-c669a09f3d3c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.300534 Aug 24 10:19:59.877948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 193/385] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:19:59 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:00.900309 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:00.901150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:00.909799 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:00.910304 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:00.911475 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:00.912280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:00.912745 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:00.913205 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:01.058664 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:01.068548 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:01.070101 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:01.071280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b680b0bc-3611-4263-85a6-61b59621d13a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.174971 Aug 24 10:20:01.072093 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 193/386] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:00 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:02.095906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:02.096506 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:02.104282 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:02.104852 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:02.105382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:02.106113 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:02.106571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:02.106995 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:02.257834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:02.267456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:02.269214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:02.271158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9323edf9-9929-4ee1-95b1-6c066b54b616 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.179372 Aug 24 10:20:02.271811 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 194/387] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:02 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:03.299405 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:03.302052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:03.314078 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.315029 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.316007 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.317504 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:03.318098 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:03.318949 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:03.484023 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:03.493800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:03.495318 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:03.496561 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-67c53a4b-0c8d-4843-9adf-bcc4cceaef36 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.204072 Aug 24 10:20:03.497155 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 194/388] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:03 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:04.521722 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:04.525901 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:04.528546 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.529057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.529491 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.530205 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:04.530657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:04.531079 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:04.664939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:04.673312 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:04.674921 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:04.676755 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2222bad1-1ae8-4ad9-9ec3-b75b25bef43c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1745 microversion: 2.20 time: 0.159893 Aug 24 10:20:04.677351 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 195/389] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:04 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:05.699610 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:05.700265 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:05.706767 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.707252 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.708277 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.709021 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:05.709525 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:05.716463 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:05.850105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:05.860470 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:05.862141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:05.863195 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f26b76fe-7def-4b53-b455-220857804d8e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1745 microversion: 2.20 time: 0.167639 Aug 24 10:20:05.865915 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 195/390] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:05 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:06.887006 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:06.887450 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:06.893763 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:06.894243 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:06.894679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:06.896016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:06.896473 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:06.897110 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:07.040064 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:07.049181 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:07.050918 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:07.053091 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c5895950-2f08-4651-bd4c-8365d02eb123 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.170248 Aug 24 10:20:07.053663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 196/391] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:06 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:08.079119 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:08.079766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:08.087122 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:08.087601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:08.088042 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:08.088749 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:08.089239 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:08.089670 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:08.340145 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:08.362494 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:08.364730 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:08.365955 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d45e9d00-157c-401b-8452-d413d4a07333 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.290783 Aug 24 10:20:08.366522 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 196/392] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:08 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:09.381818 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-e50f298c-42a2-4559-93d2-66236733472d req-10a0be4d-ca5b-48d0-b0c6-563a78f08b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac36f3b6-c66c-406b-b472-0a2dd018d4c3", "name": "network-vif-plugged", "status": "completed", "tag": "9fdb04de-4902-4316-8683-e37dc854e2b3"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:09.392693 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:09.393371 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:09.405597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:09.406081 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:09.406514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:09.409681 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e50f298c-42a2-4559-93d2-66236733472d req-10a0be4d-ca5b-48d0-b0c6-563a78f08b32 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:09.410144 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e50f298c-42a2-4559-93d2-66236733472d req-10a0be4d-ca5b-48d0-b0c6-563a78f08b32 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:09.411190 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e50f298c-42a2-4559-93d2-66236733472d req-10a0be4d-ca5b-48d0-b0c6-563a78f08b32 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:09.415137 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:09.415673 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:09.416295 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:09.429769 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-e50f298c-42a2-4559-93d2-66236733472d req-10a0be4d-ca5b-48d0-b0c6-563a78f08b32 service nova] Creating event network-vif-plugged:9fdb04de-4902-4316-8683-e37dc854e2b3 for instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 on hv-cinder-85427 Aug 24 10:20:09.436224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-e50f298c-42a2-4559-93d2-66236733472d req-10a0be4d-ca5b-48d0-b0c6-563a78f08b32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060020 Aug 24 10:20:09.440157 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 197/393] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:09.637039 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:09.637039 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:09.637987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:09.637987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-95437a83-bd45-48b4-82e0-90b7dbf070fd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.193591 Aug 24 10:20:09.637987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 197/394] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:09 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:10.611742 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:10.612516 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:10.620043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:10.620516 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:10.620972 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:10.626274 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:10.627193 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:10.627791 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:10.819507 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:10.824500 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:10.826420 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:10.828234 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-eaab82d9-67ce-49ee-904d-a19c9ff3a3ad tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.221427 Aug 24 10:20:10.829335 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 198/395] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:10 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:11.279134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-42e441cc-140d-4d21-b94d-7af4c8597530 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:11.280169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-42e441cc-140d-4d21-b94d-7af4c8597530 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:11.287535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42e441cc-140d-4d21-b94d-7af4c8597530 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.288226 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42e441cc-140d-4d21-b94d-7af4c8597530 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.288828 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42e441cc-140d-4d21-b94d-7af4c8597530 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.289694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42e441cc-140d-4d21-b94d-7af4c8597530 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.290741 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42e441cc-140d-4d21-b94d-7af4c8597530 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.291755 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42e441cc-140d-4d21-b94d-7af4c8597530 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.322042 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-42e441cc-140d-4d21-b94d-7af4c8597530 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a/ips" status: 200 len: 149 microversion: 2.1 time: 0.046590 Aug 24 10:20:11.329036 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 198/396] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Aug 24 10:20:11 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:11.335118 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21510d79-4d00-4c17-84c5-8a2fb5e443cc"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:11.340630 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:11.347460 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.348384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.349233 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.350968 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.351794 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.352698 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.496140 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Invalid volume: volume 21510d79-4d00-4c17-84c5-8a2fb5e443cc is already attached to instances: 3bf8b275-61d0-49c9-8d08-c9aba96f38af Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: POST /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a/os-volume_attachments HTTP/1.1 Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 74 Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:20:11.498266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {"volumeAttachment": {"volumeId": "21510d79-4d00-4c17-84c5-8a2fb5e443cc"}} Aug 24 10:20:11.499820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Invalid volume: volume 21510d79-4d00-4c17-84c5-8a2fb5e443cc is already attached to instances: 3bf8b275-61d0-49c9-8d08-c9aba96f38af Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'server_id': '4a33b6e4-dee4-4e74-9125-2023095d167a', 'body': {'volumeAttachment': {'volumeId': '21510d79-4d00-4c17-84c5-8a2fb5e443cc'}}} Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 21510d79-4d00-4c17-84c5-8a2fb5e443cc is already attached to instances: 3bf8b275-61d0-49c9-8d08-c9aba96f38af Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:11.500757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 21510d79-4d00-4c17-84c5-8a2fb5e443cc is already attached to instances: 3bf8b275-61d0-49c9-8d08-c9aba96f38af Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:11.502310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:11.503771 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:11.503771 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:11.503771 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:11.503771 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 21510d79-4d00-4c17-84c5-8a2fb5e443cc is already attached to instances: 3bf8b275-61d0-49c9-8d08-c9aba96f38af Aug 24 10:20:11.503771 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:11.505425 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 400 to user: Invalid volume: volume 21510d79-4d00-4c17-84c5-8a2fb5e443cc is already attached to instances: 3bf8b275-61d0-49c9-8d08-c9aba96f38af {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:11.510472 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6143c6f6-1f1f-49f1-b164-c4d9108165a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.176416 Aug 24 10:20:11.510472 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 199/397] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:20:11 2022] POST /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a/os-volume_attachments => generated 174 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:20:11.517558 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3f26d99b-a25c-4b54-9f90-0f0c7154e2d4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:11.518055 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3f26d99b-a25c-4b54-9f90-0f0c7154e2d4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:11.525095 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3f26d99b-a25c-4b54-9f90-0f0c7154e2d4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.525579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3f26d99b-a25c-4b54-9f90-0f0c7154e2d4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.526001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3f26d99b-a25c-4b54-9f90-0f0c7154e2d4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.526685 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3f26d99b-a25c-4b54-9f90-0f0c7154e2d4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.527303 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3f26d99b-a25c-4b54-9f90-0f0c7154e2d4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.528321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3f26d99b-a25c-4b54-9f90-0f0c7154e2d4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.559200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3f26d99b-a25c-4b54-9f90-0f0c7154e2d4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:20:11.857315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:11.859268 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:11.867684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.868486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.869016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.869933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.870567 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.871174 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.899197 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3f26d99b-a25c-4b54-9f90-0f0c7154e2d4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 204 len: 0 microversion: 2.1 time: 0.385227 Aug 24 10:20:11.903072 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 199/398] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:20:11 2022] DELETE /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:11.913033 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b441d73a-9ee3-4ed3-90cb-acdebdbc61cd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:11.914688 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b441d73a-9ee3-4ed3-90cb-acdebdbc61cd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:11.929406 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b441d73a-9ee3-4ed3-90cb-acdebdbc61cd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.930381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b441d73a-9ee3-4ed3-90cb-acdebdbc61cd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.930926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b441d73a-9ee3-4ed3-90cb-acdebdbc61cd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:11.932532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b441d73a-9ee3-4ed3-90cb-acdebdbc61cd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:11.933123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b441d73a-9ee3-4ed3-90cb-acdebdbc61cd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:11.933655 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b441d73a-9ee3-4ed3-90cb-acdebdbc61cd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:12.042903 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:12.052359 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:12.054143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:12.056146 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-440e77e2-1296-4920-8590-f0b2463650d3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.205904 Aug 24 10:20:12.057467 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 200/399] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:11 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:12.118416 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b441d73a-9ee3-4ed3-90cb-acdebdbc61cd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:12.129429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b441d73a-9ee3-4ed3-90cb-acdebdbc61cd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1681 microversion: 2.1 time: 0.221641 Aug 24 10:20:12.130285 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 200/400] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:11 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:12.995633 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-db39f764-ad53-407d-b71d-62c51e4bd285 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed7ef0f6-9563-4b36-96fa-aabc63dff1f3"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:12.999891 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-db39f764-ad53-407d-b71d-62c51e4bd285 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:13.009204 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-db39f764-ad53-407d-b71d-62c51e4bd285 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.009980 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-db39f764-ad53-407d-b71d-62c51e4bd285 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.010592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-db39f764-ad53-407d-b71d-62c51e4bd285 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.011325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-db39f764-ad53-407d-b71d-62c51e4bd285 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.011783 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-db39f764-ad53-407d-b71d-62c51e4bd285 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.012375 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-db39f764-ad53-407d-b71d-62c51e4bd285 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.035645 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=95 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:13.084236 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:13.084236 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:13.088884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.089441 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.090008 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.090805 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.091337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.091832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.238347 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:13.246912 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:13.248455 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:13.249580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c62d9061-b84c-414c-abbb-96c604a57a8f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.173749 Aug 24 10:20:13.250137 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 201/401] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:13 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:13.255119 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-5c239c93-3a10-4b4f-ad7c-27ade88bead4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:13.255873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-5c239c93-3a10-4b4f-ad7c-27ade88bead4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:13.265989 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c239c93-3a10-4b4f-ad7c-27ade88bead4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.266483 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c239c93-3a10-4b4f-ad7c-27ade88bead4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.266912 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c239c93-3a10-4b4f-ad7c-27ade88bead4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.267651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c239c93-3a10-4b4f-ad7c-27ade88bead4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:13.268099 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c239c93-3a10-4b4f-ad7c-27ade88bead4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:13.268522 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c239c93-3a10-4b4f-ad7c-27ade88bead4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:13.416794 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-5c239c93-3a10-4b4f-ad7c-27ade88bead4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:13.429226 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-5c239c93-3a10-4b4f-ad7c-27ade88bead4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1681 microversion: 2.1 time: 0.177961 Aug 24 10:20:13.429941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 202/402] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:13 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:14.275348 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:14.276898 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:14.283827 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.284437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.285140 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.286822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.287382 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.288075 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.467870 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-db39f764-ad53-407d-b71d-62c51e4bd285 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.475993 Aug 24 10:20:14.469536 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 201/403] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:20:12 2022] POST /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments => generated 194 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:14.470934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:14.479021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-23587b61-e02d-41ea-a7f1-e552a6d8b2b5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:14.485184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-23587b61-e02d-41ea-a7f1-e552a6d8b2b5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:14.501878 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-23587b61-e02d-41ea-a7f1-e552a6d8b2b5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.503987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-23587b61-e02d-41ea-a7f1-e552a6d8b2b5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.509517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-23587b61-e02d-41ea-a7f1-e552a6d8b2b5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.509517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-23587b61-e02d-41ea-a7f1-e552a6d8b2b5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:14.509517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-23587b61-e02d-41ea-a7f1-e552a6d8b2b5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:14.509517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-23587b61-e02d-41ea-a7f1-e552a6d8b2b5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:14.537807 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:14.537807 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:14.538591 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0a9581b0-5e0c-4214-8a41-35710bf72649 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.267525 Aug 24 10:20:14.540775 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 203/404] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:14 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:14.674744 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-23587b61-e02d-41ea-a7f1-e552a6d8b2b5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:14.682868 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-23587b61-e02d-41ea-a7f1-e552a6d8b2b5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1614 microversion: 2.1 time: 0.211939 Aug 24 10:20:14.701473 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 202/405] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:14 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1614 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:15.007249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-1076e3df-5786-4b13-8067-e90cd7b0fc3a req-08ef4082-8f05-4eff-84b4-978acdcb52d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a33b6e4-dee4-4e74-9125-2023095d167a", "name": "network-vif-deleted", "tag": "4b428aa4-0631-4aa6-82a7-97e1e11db86e"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:15.022509 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-1076e3df-5786-4b13-8067-e90cd7b0fc3a req-08ef4082-8f05-4eff-84b4-978acdcb52d1 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.022991 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-1076e3df-5786-4b13-8067-e90cd7b0fc3a req-08ef4082-8f05-4eff-84b4-978acdcb52d1 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.024441 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-1076e3df-5786-4b13-8067-e90cd7b0fc3a req-08ef4082-8f05-4eff-84b4-978acdcb52d1 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.062201 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-1076e3df-5786-4b13-8067-e90cd7b0fc3a req-08ef4082-8f05-4eff-84b4-978acdcb52d1 service nova] Creating event network-vif-deleted:4b428aa4-0631-4aa6-82a7-97e1e11db86e for instance 4a33b6e4-dee4-4e74-9125-2023095d167a on hv-cinder-85427 Aug 24 10:20:15.068466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-1076e3df-5786-4b13-8067-e90cd7b0fc3a req-08ef4082-8f05-4eff-84b4-978acdcb52d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065838 Aug 24 10:20:15.070614 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 204/406] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:15.564413 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:15.565086 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:15.572462 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.573302 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.573976 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.574916 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.575618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.576366 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.710544 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:15.711842 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:15.724121 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.736122 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.736959 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.737920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.738634 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.739551 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.751984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:15.762919 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:15.772489 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:15.774037 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:15.775855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-de87cb69-8c77-4617-881b-9c8a37b6bd52 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.214983 Aug 24 10:20:15.789688 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 203/407] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:15 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:15.815453 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:15.816041 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:15.816604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:15.817335 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lazy-loading 'fault' on Instance uuid 4a33b6e4-dee4-4e74-9125-2023095d167a {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:15.892505 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:15.913207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b4b4cb6b-ba07-4129-80cf-1c8a0aca884a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1332 microversion: 2.1 time: 0.197942 Aug 24 10:20:15.929697 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 205/408] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:15 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1332 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:16.801754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:16.803152 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:16.811216 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.816888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.816888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.816888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.816888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.817276 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.940916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:16.942357 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:16.949706 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.950392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.950826 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.952306 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.952832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.953279 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.979841 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:16.988307 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:16.990209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:16.990970 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:16.991636 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lazy-loading 'fault' on Instance uuid 4a33b6e4-dee4-4e74-9125-2023095d167a {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:16.992306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:16.994227 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:16.995481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ba53776a-ed51-4af8-af95-cdcad1e48008 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.199642 Aug 24 10:20:16.996055 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 204/409] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:16 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:17.034835 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:17.043643 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1dfc3146-ed52-48ad-a9e1-fec740ed27a7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1332 microversion: 2.1 time: 0.109143 Aug 24 10:20:17.044217 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 206/410] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:16 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:18.019129 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:18.020828 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:18.030293 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.031157 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.031829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.035518 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.036467 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.037167 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.065821 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:18.066555 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:18.082566 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.083219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.083889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.084969 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.085616 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.086246 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.134772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.135375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.136276 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.137589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lazy-loading 'fault' on Instance uuid 4a33b6e4-dee4-4e74-9125-2023095d167a {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:18.224635 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:18.229719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:18.242978 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-52db5f9b-234a-4811-a8d7-665053d8dd76 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 200 len: 1332 microversion: 2.1 time: 0.181441 Aug 24 10:20:18.244190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 207/411] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:18 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 1332 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:18.261252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:18.263328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:18.278644 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-00a36d34-3a12-4331-8231-eeb31038306b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.249904 Aug 24 10:20:18.278806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c045fce6-876a-4170-a857-cd425944e935 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:18.278806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c045fce6-876a-4170-a857-cd425944e935 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:18.279006 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 205/412] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:18 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:18.279102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c045fce6-876a-4170-a857-cd425944e935 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.279102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c045fce6-876a-4170-a857-cd425944e935 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.279102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c045fce6-876a-4170-a857-cd425944e935 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.279102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c045fce6-876a-4170-a857-cd425944e935 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:18.279429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c045fce6-876a-4170-a857-cd425944e935 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:18.279429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c045fce6-876a-4170-a857-cd425944e935 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:18.436584 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-c045fce6-876a-4170-a857-cd425944e935 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lazy-loading 'services' on Instance uuid 29717cf7-618e-46fd-96cd-12597975a07c {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:18.823028 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c045fce6-876a-4170-a857-cd425944e935 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "DELETE /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/os-volume_attachments/b380dc08-ffd0-4df6-a4ba-f80fcbf9466c" status: 202 len: 0 microversion: 2.1 time: 0.577238 Aug 24 10:20:18.823644 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 208/413] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:20:18 2022] DELETE /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/os-volume_attachments/b380dc08-ffd0-4df6-a4ba-f80fcbf9466c => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:20:19.268202 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:19.268946 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:19.277121 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:19.277625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:19.278058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:19.278755 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:19.279205 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:19.279624 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:19.295960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a HTTP/1.1 Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:20:19.298104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:20:19.300100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '4a33b6e4-dee4-4e74-9125-2023095d167a'} Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:19.302206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:20:19.304239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:19.306160 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:19.306579 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:19.306682 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:19.306768 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-66712e31-2fee-4a9e-8da5-3886cf7d9a18 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 404 len: 111 microversion: 2.1 time: 0.035646 Aug 24 10:20:19.306768 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 206/414] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:19 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:19.310069 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:19.310220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7d9bd07d-6861-430a-a3ad-e1a75592a2bd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '.version_select at 0x7f0af432ab80>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:19.310538 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:19.310973 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:19.311672 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:19.312124 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:19.312603 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:19.315356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7d9bd07d-6861-430a-a3ad-e1a75592a2bd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [f7f2e5a4-e945-4524-9539-d987688b529f] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:20:19.455355 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:19.463549 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:19.465121 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:19.466272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1c85870b-b1b6-4a57-a5f5-6089df3bc2fb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1740 microversion: 2.20 time: 0.173099 Aug 24 10:20:19.466843 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 209/415] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:19 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:20.321958 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO oslo.messaging._drivers.impl_rabbit [None req-7d9bd07d-6861-430a-a3ad-e1a75592a2bd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [f7f2e5a4-e945-4524-9539-d987688b529f] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 45666. Aug 24 10:20:20.424589 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7d9bd07d-6861-430a-a3ad-e1a75592a2bd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119419808" status: 202 len: 0 microversion: 2.1 time: 1.118880 Aug 24 10:20:20.429143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 207/416] 10.222.0.30 () {58 vars in 1221 bytes} [Wed Aug 24 10:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119419808 => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:20:20.490185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:20.490801 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:20.497240 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:20.497722 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:20.498160 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:20.498856 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:20.499309 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:20.499732 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:20.634184 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:20.642297 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:20.643917 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:20.645696 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-aa316a80-4af9-4c1e-b7dd-be3ebf4c05ff tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1722 microversion: 2.20 time: 0.159486 Aug 24 10:20:20.646253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 210/417] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:20 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:21.273780 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2d68e821-cfd4-466e-bdba-8050372f44a8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:21.274267 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2d68e821-cfd4-466e-bdba-8050372f44a8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:21.281628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d68e821-cfd4-466e-bdba-8050372f44a8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:21.282105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d68e821-cfd4-466e-bdba-8050372f44a8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:21.282535 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d68e821-cfd4-466e-bdba-8050372f44a8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:21.283217 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d68e821-cfd4-466e-bdba-8050372f44a8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:21.283664 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d68e821-cfd4-466e-bdba-8050372f44a8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:21.284079 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d68e821-cfd4-466e-bdba-8050372f44a8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:21.409565 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-2d68e821-cfd4-466e-bdba-8050372f44a8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lazy-loading 'services' on Instance uuid 3bf8b275-61d0-49c9-8d08-c9aba96f38af {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:21.685288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:21.685854 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:21.688251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:21.693136 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:21.693620 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:21.694052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:21.694751 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:21.695914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:21.695914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:21.700563 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2d68e821-cfd4-466e-bdba-8050372f44a8 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments/21510d79-4d00-4c17-84c5-8a2fb5e443cc" status: 202 len: 0 microversion: 2.1 time: 0.429847 Aug 24 10:20:21.700563 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 208/418] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:20:21 2022] DELETE /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments/21510d79-4d00-4c17-84c5-8a2fb5e443cc => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:20:21.706978 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bc20bceb-14a4-47fe-8183-eefcb140eec4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:21.709837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bc20bceb-14a4-47fe-8183-eefcb140eec4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:21.716071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc20bceb-14a4-47fe-8183-eefcb140eec4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:21.716562 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc20bceb-14a4-47fe-8183-eefcb140eec4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:21.717062 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc20bceb-14a4-47fe-8183-eefcb140eec4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:21.717826 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc20bceb-14a4-47fe-8183-eefcb140eec4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:21.718298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc20bceb-14a4-47fe-8183-eefcb140eec4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:21.718699 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc20bceb-14a4-47fe-8183-eefcb140eec4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:21.749483 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bc20bceb-14a4-47fe-8183-eefcb140eec4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046677 Aug 24 10:20:21.750057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 209/419] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:21 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:20:21.828655 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:21.837884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:21.839389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:21.840654 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8fc5a561-1c20-4d46-b872-4a4621c816ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1722 microversion: 2.20 time: 0.159348 Aug 24 10:20:21.841248 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 211/420] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:21 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:22.762173 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-10db0d7c-4ad8-44e6-84a7-e7149caf8793 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:22.767021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-10db0d7c-4ad8-44e6-84a7-e7149caf8793 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:22.771207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10db0d7c-4ad8-44e6-84a7-e7149caf8793 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:22.771750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10db0d7c-4ad8-44e6-84a7-e7149caf8793 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:22.772187 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10db0d7c-4ad8-44e6-84a7-e7149caf8793 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:22.772909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10db0d7c-4ad8-44e6-84a7-e7149caf8793 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:22.773375 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10db0d7c-4ad8-44e6-84a7-e7149caf8793 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:22.773797 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10db0d7c-4ad8-44e6-84a7-e7149caf8793 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:22.806942 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-10db0d7c-4ad8-44e6-84a7-e7149caf8793 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048753 Aug 24 10:20:22.807534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 210/421] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:22 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:22.866268 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:22.867761 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:22.873941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:22.874428 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:22.874870 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:22.875572 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:22.876266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:22.876883 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:23.013712 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:23.022935 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:23.024513 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:23.025736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-06bf3736-cbad-44f6-97b6-32378a130776 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1722 microversion: 2.20 time: 0.166273 Aug 24 10:20:23.026302 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 212/422] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:22 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:23.819367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ce2e03c3-c333-48f5-9cf4-f76113932632 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:23.821588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ce2e03c3-c333-48f5-9cf4-f76113932632 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:23.828043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce2e03c3-c333-48f5-9cf4-f76113932632 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:23.834071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce2e03c3-c333-48f5-9cf4-f76113932632 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:23.834071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce2e03c3-c333-48f5-9cf4-f76113932632 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:23.834071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce2e03c3-c333-48f5-9cf4-f76113932632 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:23.834071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce2e03c3-c333-48f5-9cf4-f76113932632 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:23.834427 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ce2e03c3-c333-48f5-9cf4-f76113932632 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:23.860421 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ce2e03c3-c333-48f5-9cf4-f76113932632 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Aug 24 10:20:23.861021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 211/423] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:23 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:24.049370 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:24.049898 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:24.057070 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.057547 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.057977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:24.058717 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.059167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.059585 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:24.206509 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:24.215055 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:24.216550 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:24.217733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-beba1c4d-6d92-41eb-9c84-5f1f8ba2e549 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1722 microversion: 2.20 time: 0.172537 Aug 24 10:20:24.218290 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 213/424] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:24 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:24.873596 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6259fbe7-b6c7-44a2-8819-e2bcdb2dfbf2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:24.875710 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6259fbe7-b6c7-44a2-8819-e2bcdb2dfbf2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:24.878257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:24.883687 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6259fbe7-b6c7-44a2-8819-e2bcdb2dfbf2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.884168 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6259fbe7-b6c7-44a2-8819-e2bcdb2dfbf2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.884593 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6259fbe7-b6c7-44a2-8819-e2bcdb2dfbf2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:24.885302 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6259fbe7-b6c7-44a2-8819-e2bcdb2dfbf2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:24.885748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6259fbe7-b6c7-44a2-8819-e2bcdb2dfbf2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:24.889577 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6259fbe7-b6c7-44a2-8819-e2bcdb2dfbf2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:24.917175 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6259fbe7-b6c7-44a2-8819-e2bcdb2dfbf2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047443 Aug 24 10:20:24.917734 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 212/425] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:24 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:25.242267 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:25.243224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:25.251948 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:25.253057 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:25.253847 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:25.255126 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:25.257092 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:25.257868 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:25.400482 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:25.408613 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:25.410152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:25.411305 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-fdbf9318-2fef-4bd0-b99c-291b2be4c52a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1722 microversion: 2.20 time: 0.174222 Aug 24 10:20:25.411883 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 214/426] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:25 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:25.930882 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-553dcb83-4594-4e8f-acd5-8c2b5b4c6f20 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:25.933027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-553dcb83-4594-4e8f-acd5-8c2b5b4c6f20 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:25.939351 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-553dcb83-4594-4e8f-acd5-8c2b5b4c6f20 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:25.939829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-553dcb83-4594-4e8f-acd5-8c2b5b4c6f20 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:25.940264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-553dcb83-4594-4e8f-acd5-8c2b5b4c6f20 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:25.941010 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-553dcb83-4594-4e8f-acd5-8c2b5b4c6f20 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:25.941460 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-553dcb83-4594-4e8f-acd5-8c2b5b4c6f20 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:25.941891 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-553dcb83-4594-4e8f-acd5-8c2b5b4c6f20 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:25.970813 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-553dcb83-4594-4e8f-acd5-8c2b5b4c6f20 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045217 Aug 24 10:20:25.972020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 213/427] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:25 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:26.434448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:26.435092 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:26.441566 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:26.442070 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:26.442511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:26.443205 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:26.444210 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:26.444638 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:26.804940 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:26.813303 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:26.814866 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:26.816086 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4b8b2f83-148d-4cb5-86fa-331df5109647 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1722 microversion: 2.20 time: 0.385552 Aug 24 10:20:26.816648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 215/428] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:26 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:26.989981 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3ed6c7f3-2d3e-404f-98ef-50f849c84985 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:26.992663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3ed6c7f3-2d3e-404f-98ef-50f849c84985 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:27.000399 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3ed6c7f3-2d3e-404f-98ef-50f849c84985 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.000884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3ed6c7f3-2d3e-404f-98ef-50f849c84985 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.001475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3ed6c7f3-2d3e-404f-98ef-50f849c84985 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.002208 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3ed6c7f3-2d3e-404f-98ef-50f849c84985 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.002675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3ed6c7f3-2d3e-404f-98ef-50f849c84985 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.003109 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3ed6c7f3-2d3e-404f-98ef-50f849c84985 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.020386 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-87a71a4a-f350-4c2d-a7e5-ae02fd0164fd req-7ea78aa8-5922-4cef-9deb-b87178b71bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac36f3b6-c66c-406b-b472-0a2dd018d4c3", "name": "network-vif-unplugged", "status": "completed", "tag": "9fdb04de-4902-4316-8683-e37dc854e2b3"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:27.030492 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-87a71a4a-f350-4c2d-a7e5-ae02fd0164fd req-7ea78aa8-5922-4cef-9deb-b87178b71bc3 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.031108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-87a71a4a-f350-4c2d-a7e5-ae02fd0164fd req-7ea78aa8-5922-4cef-9deb-b87178b71bc3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.031539 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-87a71a4a-f350-4c2d-a7e5-ae02fd0164fd req-7ea78aa8-5922-4cef-9deb-b87178b71bc3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.034561 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3ed6c7f3-2d3e-404f-98ef-50f849c84985 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054554 Aug 24 10:20:27.035143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 214/429] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:26 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:27.043157 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-87a71a4a-f350-4c2d-a7e5-ae02fd0164fd req-7ea78aa8-5922-4cef-9deb-b87178b71bc3 service nova] Creating event network-vif-unplugged:9fdb04de-4902-4316-8683-e37dc854e2b3 for instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 on hv-cinder-85427 Aug 24 10:20:27.048148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-87a71a4a-f350-4c2d-a7e5-ae02fd0164fd req-7ea78aa8-5922-4cef-9deb-b87178b71bc3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032021 Aug 24 10:20:27.048705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 216/430] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:20:27.839234 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:27.839862 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:27.845949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.846420 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.846846 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.847521 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:27.847964 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:27.848378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:27.983257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:27.992728 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:27.994329 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:27.995554 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e6feef78-02db-4829-8775-408a4293070c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1725 microversion: 2.20 time: 0.160536 Aug 24 10:20:27.996103 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 215/431] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:27 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:28.022839 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-18974f8f-6bef-4292-b6a7-a87b5197031c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bf7b7f8-8206-47de-8686-9cf36adb8426"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:28.025444 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-18974f8f-6bef-4292-b6a7-a87b5197031c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:28.032711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18974f8f-6bef-4292-b6a7-a87b5197031c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:28.033313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18974f8f-6bef-4292-b6a7-a87b5197031c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:28.033806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18974f8f-6bef-4292-b6a7-a87b5197031c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:28.034532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18974f8f-6bef-4292-b6a7-a87b5197031c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:28.034891 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18974f8f-6bef-4292-b6a7-a87b5197031c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:28.035322 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18974f8f-6bef-4292-b6a7-a87b5197031c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:28.054596 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e2cd8972-2705-4d99-8459-76f8e5343eaf tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:28.054596 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-e2cd8972-2705-4d99-8459-76f8e5343eaf tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:28.057545 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e2cd8972-2705-4d99-8459-76f8e5343eaf tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:28.058028 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e2cd8972-2705-4d99-8459-76f8e5343eaf tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:28.058457 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e2cd8972-2705-4d99-8459-76f8e5343eaf tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:28.059141 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e2cd8972-2705-4d99-8459-76f8e5343eaf tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:28.059745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e2cd8972-2705-4d99-8459-76f8e5343eaf tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:28.060296 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e2cd8972-2705-4d99-8459-76f8e5343eaf tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:28.097194 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e2cd8972-2705-4d99-8459-76f8e5343eaf tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053263 Aug 24 10:20:28.106039 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 216/432] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:28 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:20:29.116584 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ba411acb-8900-451b-969e-bb785da2a214 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:29.118769 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ba411acb-8900-451b-969e-bb785da2a214 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:29.125581 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba411acb-8900-451b-969e-bb785da2a214 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.126061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba411acb-8900-451b-969e-bb785da2a214 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.126492 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba411acb-8900-451b-969e-bb785da2a214 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.127180 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba411acb-8900-451b-969e-bb785da2a214 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.127629 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba411acb-8900-451b-969e-bb785da2a214 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.128044 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba411acb-8900-451b-969e-bb785da2a214 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.141862 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:29.158954 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ba411acb-8900-451b-969e-bb785da2a214 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046548 Aug 24 10:20:29.159538 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 217/433] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:29 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:20:29.228754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-18974f8f-6bef-4292-b6a7-a87b5197031c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "POST /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.211727 Aug 24 10:20:29.229524 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 217/434] 10.222.0.30 () {62 vars in 1364 bytes} [Wed Aug 24 10:20:28 2022] POST /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments => generated 188 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:20:29.360929 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7cd79500-a857-43f9-b60d-aa0ea98ec8cc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:29.361548 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7cd79500-a857-43f9-b60d-aa0ea98ec8cc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:29.368341 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7cd79500-a857-43f9-b60d-aa0ea98ec8cc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.368825 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7cd79500-a857-43f9-b60d-aa0ea98ec8cc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.372020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7cd79500-a857-43f9-b60d-aa0ea98ec8cc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.372020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7cd79500-a857-43f9-b60d-aa0ea98ec8cc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.372020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7cd79500-a857-43f9-b60d-aa0ea98ec8cc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.372020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7cd79500-a857-43f9-b60d-aa0ea98ec8cc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.414123 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7cd79500-a857-43f9-b60d-aa0ea98ec8cc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121270) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 10:20:29.560926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a1c297db-4383-431c-b576-2e022fe622ae tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:29.563092 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a1c297db-4383-431c-b576-2e022fe622ae tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:29.569795 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1c297db-4383-431c-b576-2e022fe622ae tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.570293 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1c297db-4383-431c-b576-2e022fe622ae tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.570730 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1c297db-4383-431c-b576-2e022fe622ae tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.571429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1c297db-4383-431c-b576-2e022fe622ae tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.571883 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1c297db-4383-431c-b576-2e022fe622ae tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.572363 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1c297db-4383-431c-b576-2e022fe622ae tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.576296 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:29.597154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-a1c297db-4383-431c-b576-2e022fe622ae tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lazy-loading 'flavor' on Instance uuid ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:20:29.717731 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7cd79500-a857-43f9-b60d-aa0ea98ec8cc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "POST /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/action" status: 202 len: 0 microversion: 2.20 time: 0.360722 Aug 24 10:20:29.718550 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 218/435] 10.222.0.30 () {62 vars in 1319 bytes} [Wed Aug 24 10:20:29 2022] POST /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:29.726582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:29.727248 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:29.733367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.733791 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.734225 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.734917 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.735772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.739395 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.885829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:29.894643 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:29.896155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:29.897396 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0cba6925-c442-46fc-8b69-bbf3bdfad1a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1751 microversion: 2.20 time: 0.174747 Aug 24 10:20:29.897956 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 219/436] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:29 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:29.918966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a1c297db-4383-431c-b576-2e022fe622ae tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/action" status: 200 len: 32 microversion: 2.1 time: 0.362030 Aug 24 10:20:29.919566 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 218/437] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:20:29 2022] POST /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:20:29.929892 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-49ab5085-3996-4571-a33c-e30d64aa0d3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:29.930783 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-49ab5085-3996-4571-a33c-e30d64aa0d3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:29.938268 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ab5085-3996-4571-a33c-e30d64aa0d3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.938750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ab5085-3996-4571-a33c-e30d64aa0d3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.939184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ab5085-3996-4571-a33c-e30d64aa0d3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:29.939924 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ab5085-3996-4571-a33c-e30d64aa0d3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:29.940403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ab5085-3996-4571-a33c-e30d64aa0d3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:29.940835 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ab5085-3996-4571-a33c-e30d64aa0d3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.084629 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-49ab5085-3996-4571-a33c-e30d64aa0d3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:30.095589 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-49ab5085-3996-4571-a33c-e30d64aa0d3c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.170428 Aug 24 10:20:30.096831 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 220/438] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:29 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:30.173498 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-5a197eaa-7655-4996-b26c-c229a45bb895 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:30.175937 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-5a197eaa-7655-4996-b26c-c229a45bb895 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:30.183108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a197eaa-7655-4996-b26c-c229a45bb895 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.183593 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a197eaa-7655-4996-b26c-c229a45bb895 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.184080 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a197eaa-7655-4996-b26c-c229a45bb895 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.184750 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a197eaa-7655-4996-b26c-c229a45bb895 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.185245 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a197eaa-7655-4996-b26c-c229a45bb895 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.185667 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a197eaa-7655-4996-b26c-c229a45bb895 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.218834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-5a197eaa-7655-4996-b26c-c229a45bb895 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050545 Aug 24 10:20:30.219442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 219/439] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:30 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:30.671990 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-77ae23de-bd55-44cc-80b7-1523157a76c5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:30.679337 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-77ae23de-bd55-44cc-80b7-1523157a76c5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.679692 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-77ae23de-bd55-44cc-80b7-1523157a76c5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.680149 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-77ae23de-bd55-44cc-80b7-1523157a76c5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.762751 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-77ae23de-bd55-44cc-80b7-1523157a76c5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Going to try to stop instance {{(pid=121270) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 10:20:30.920714 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:30.921595 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:30.929178 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.930014 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.930514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.931284 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:30.931990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:30.932621 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:30.998472 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-77ae23de-bd55-44cc-80b7-1523157a76c5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/action" status: 202 len: 0 microversion: 2.1 time: 0.330172 Aug 24 10:20:30.999667 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 221/440] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:20:30 2022] POST /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:20:31.008234 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c8cd00b6-da49-402a-a77e-3b4b0e7eb276 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:31.009232 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c8cd00b6-da49-402a-a77e-3b4b0e7eb276 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:31.021899 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8cd00b6-da49-402a-a77e-3b4b0e7eb276 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.022409 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8cd00b6-da49-402a-a77e-3b4b0e7eb276 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.022853 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8cd00b6-da49-402a-a77e-3b4b0e7eb276 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.028286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8cd00b6-da49-402a-a77e-3b4b0e7eb276 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.028286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8cd00b6-da49-402a-a77e-3b4b0e7eb276 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.028286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8cd00b6-da49-402a-a77e-3b4b0e7eb276 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.079177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:31.090074 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:31.091972 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:31.093210 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-aff81b36-029d-4254-8218-ab5f063cc960 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1751 microversion: 2.20 time: 0.176410 Aug 24 10:20:31.093764 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 220/441] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:30 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:31.121029 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-399cf7f4-cc30-4fe0-9fbf-b887bc0ca6d4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:31.121947 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-399cf7f4-cc30-4fe0-9fbf-b887bc0ca6d4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:31.131988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-399cf7f4-cc30-4fe0-9fbf-b887bc0ca6d4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.132496 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-399cf7f4-cc30-4fe0-9fbf-b887bc0ca6d4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.132968 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-399cf7f4-cc30-4fe0-9fbf-b887bc0ca6d4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.134484 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-399cf7f4-cc30-4fe0-9fbf-b887bc0ca6d4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.135626 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-399cf7f4-cc30-4fe0-9fbf-b887bc0ca6d4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.137010 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-399cf7f4-cc30-4fe0-9fbf-b887bc0ca6d4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.184076 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c8cd00b6-da49-402a-a77e-3b4b0e7eb276 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:31.193828 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c8cd00b6-da49-402a-a77e-3b4b0e7eb276 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1677 microversion: 2.1 time: 0.189920 Aug 24 10:20:31.196683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 222/442] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:31 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:31.233404 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-703e6fa8-8ad4-4c43-be5e-6c6d24bae2fb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:31.236168 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-703e6fa8-8ad4-4c43-be5e-6c6d24bae2fb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:31.244492 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-703e6fa8-8ad4-4c43-be5e-6c6d24bae2fb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.245310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-703e6fa8-8ad4-4c43-be5e-6c6d24bae2fb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.245961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-703e6fa8-8ad4-4c43-be5e-6c6d24bae2fb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.246880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-703e6fa8-8ad4-4c43-be5e-6c6d24bae2fb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.247515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-703e6fa8-8ad4-4c43-be5e-6c6d24bae2fb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.248154 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-703e6fa8-8ad4-4c43-be5e-6c6d24bae2fb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.279306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-703e6fa8-8ad4-4c43-be5e-6c6d24bae2fb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051495 Aug 24 10:20:31.279985 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 223/443] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:20:31 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:20:31.316807 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-399cf7f4-cc30-4fe0-9fbf-b887bc0ca6d4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:31.325901 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-399cf7f4-cc30-4fe0-9fbf-b887bc0ca6d4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.210346 Aug 24 10:20:31.326538 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 221/444] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:31 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:31.352204 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3170a1bd-8ddb-405b-9e7f-d27e8fd80367 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:31.352756 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3170a1bd-8ddb-405b-9e7f-d27e8fd80367 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:31.358704 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3170a1bd-8ddb-405b-9e7f-d27e8fd80367 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.359181 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3170a1bd-8ddb-405b-9e7f-d27e8fd80367 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.359611 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3170a1bd-8ddb-405b-9e7f-d27e8fd80367 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.360298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3170a1bd-8ddb-405b-9e7f-d27e8fd80367 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.360746 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3170a1bd-8ddb-405b-9e7f-d27e8fd80367 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.362274 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3170a1bd-8ddb-405b-9e7f-d27e8fd80367 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.388440 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3170a1bd-8ddb-405b-9e7f-d27e8fd80367 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Going to try to terminate instance {{(pid=121270) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:20:31.737808 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3170a1bd-8ddb-405b-9e7f-d27e8fd80367 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 204 len: 0 microversion: 2.1 time: 0.389740 Aug 24 10:20:31.738905 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 224/445] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:20:31 2022] DELETE /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:20:31.747544 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-810115c9-262c-45a8-8ff9-4dbcea4a2db3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:31.748162 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-810115c9-262c-45a8-8ff9-4dbcea4a2db3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:31.754109 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-810115c9-262c-45a8-8ff9-4dbcea4a2db3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.754589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-810115c9-262c-45a8-8ff9-4dbcea4a2db3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.755025 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-810115c9-262c-45a8-8ff9-4dbcea4a2db3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.755726 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-810115c9-262c-45a8-8ff9-4dbcea4a2db3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:31.756299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-810115c9-262c-45a8-8ff9-4dbcea4a2db3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:31.756726 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-810115c9-262c-45a8-8ff9-4dbcea4a2db3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:31.887214 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-810115c9-262c-45a8-8ff9-4dbcea4a2db3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:31.895245 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-810115c9-262c-45a8-8ff9-4dbcea4a2db3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1682 microversion: 2.1 time: 0.151174 Aug 24 10:20:31.895538 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 222/446] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:31 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:32.118075 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:32.118859 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:32.124799 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:32.125311 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:32.125742 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:32.126424 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:32.126873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:32.127292 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:32.215936 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c71338b7-8dd8-40fb-aa7b-682e8210f8ab tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:32.216654 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c71338b7-8dd8-40fb-aa7b-682e8210f8ab tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:32.222988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c71338b7-8dd8-40fb-aa7b-682e8210f8ab tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:32.223477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c71338b7-8dd8-40fb-aa7b-682e8210f8ab tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:32.223916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c71338b7-8dd8-40fb-aa7b-682e8210f8ab tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:32.225223 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c71338b7-8dd8-40fb-aa7b-682e8210f8ab tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:32.225751 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c71338b7-8dd8-40fb-aa7b-682e8210f8ab tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:32.226180 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c71338b7-8dd8-40fb-aa7b-682e8210f8ab tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:32.257991 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:32.266834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:32.268456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:32.269919 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-915721e4-eb47-436d-a453-18d23816f336 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1753 microversion: 2.20 time: 0.156783 Aug 24 10:20:32.270477 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 225/447] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:32 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:32.349025 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f880b464-ba8e-4c94-9df5-009fcf8d09e9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:32.350232 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f880b464-ba8e-4c94-9df5-009fcf8d09e9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:32.356601 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f880b464-ba8e-4c94-9df5-009fcf8d09e9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:32.357308 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f880b464-ba8e-4c94-9df5-009fcf8d09e9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:32.357877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f880b464-ba8e-4c94-9df5-009fcf8d09e9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:32.358587 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f880b464-ba8e-4c94-9df5-009fcf8d09e9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:32.359072 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f880b464-ba8e-4c94-9df5-009fcf8d09e9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:32.359498 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f880b464-ba8e-4c94-9df5-009fcf8d09e9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:32.359797 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c71338b7-8dd8-40fb-aa7b-682e8210f8ab tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:32.368300 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c71338b7-8dd8-40fb-aa7b-682e8210f8ab tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1677 microversion: 2.1 time: 0.156134 Aug 24 10:20:32.369027 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 223/448] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:32 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:32.496456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f880b464-ba8e-4c94-9df5-009fcf8d09e9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:32.504645 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f880b464-ba8e-4c94-9df5-009fcf8d09e9 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.159440 Aug 24 10:20:32.505270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 226/449] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:32 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:32.921987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-87363159-e2cc-452a-babe-019526efcd02 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:32.922527 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-87363159-e2cc-452a-babe-019526efcd02 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:32.929535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87363159-e2cc-452a-babe-019526efcd02 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:32.930016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87363159-e2cc-452a-babe-019526efcd02 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:32.930448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87363159-e2cc-452a-babe-019526efcd02 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:32.931161 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87363159-e2cc-452a-babe-019526efcd02 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:32.931613 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87363159-e2cc-452a-babe-019526efcd02 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:32.932035 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-87363159-e2cc-452a-babe-019526efcd02 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:33.061748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-87363159-e2cc-452a-babe-019526efcd02 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:33.069981 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-87363159-e2cc-452a-babe-019526efcd02 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1682 microversion: 2.1 time: 0.152061 Aug 24 10:20:33.070553 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 224/450] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:32 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:33.294149 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:33.294757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:33.301363 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:33.301849 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:33.302286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:33.303681 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:33.304135 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:33.304557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:33.389729 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b270692f-30fa-44d7-8b77-abde0ca05353 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:33.390351 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b270692f-30fa-44d7-8b77-abde0ca05353 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:33.397237 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b270692f-30fa-44d7-8b77-abde0ca05353 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:33.398682 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b270692f-30fa-44d7-8b77-abde0ca05353 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:33.398682 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b270692f-30fa-44d7-8b77-abde0ca05353 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:33.398920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b270692f-30fa-44d7-8b77-abde0ca05353 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:33.399327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b270692f-30fa-44d7-8b77-abde0ca05353 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:33.399754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b270692f-30fa-44d7-8b77-abde0ca05353 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:33.437432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:33.447083 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:33.448616 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:33.449897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-94aa8152-5161-4db5-9304-f6b4bd34d827 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1753 microversion: 2.20 time: 0.159870 Aug 24 10:20:33.450458 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 227/451] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:33 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:33.527230 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5d98876b-7cb4-4c8c-ac64-e6f80756d5b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:33.527760 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5d98876b-7cb4-4c8c-ac64-e6f80756d5b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:33.533948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5d98876b-7cb4-4c8c-ac64-e6f80756d5b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:33.534420 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5d98876b-7cb4-4c8c-ac64-e6f80756d5b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:33.535087 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5d98876b-7cb4-4c8c-ac64-e6f80756d5b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:33.539219 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5d98876b-7cb4-4c8c-ac64-e6f80756d5b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:33.543475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5d98876b-7cb4-4c8c-ac64-e6f80756d5b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:33.543600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b270692f-30fa-44d7-8b77-abde0ca05353 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:33.543713 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5d98876b-7cb4-4c8c-ac64-e6f80756d5b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:33.548054 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b270692f-30fa-44d7-8b77-abde0ca05353 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1677 microversion: 2.1 time: 0.162150 Aug 24 10:20:33.548633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 225/452] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:33 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:33.674594 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5d98876b-7cb4-4c8c-ac64-e6f80756d5b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:33.683208 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5d98876b-7cb4-4c8c-ac64-e6f80756d5b2 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.159943 Aug 24 10:20:33.683860 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 228/453] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:33 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:34.091187 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-93122e70-63fe-432b-8362-9e8912b75ff6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:34.091966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-93122e70-63fe-432b-8362-9e8912b75ff6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:34.098042 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-93122e70-63fe-432b-8362-9e8912b75ff6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.098591 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-93122e70-63fe-432b-8362-9e8912b75ff6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.099022 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-93122e70-63fe-432b-8362-9e8912b75ff6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.099822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-93122e70-63fe-432b-8362-9e8912b75ff6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.100589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-93122e70-63fe-432b-8362-9e8912b75ff6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.101041 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-93122e70-63fe-432b-8362-9e8912b75ff6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.242360 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-93122e70-63fe-432b-8362-9e8912b75ff6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:34.250662 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-93122e70-63fe-432b-8362-9e8912b75ff6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1682 microversion: 2.1 time: 0.163427 Aug 24 10:20:34.251414 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 226/454] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:34 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:34.480832 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:34.484650 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:34.495007 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.495486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.495916 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.496623 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.497115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.497729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.570496 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a1fd6b83-4ee5-4227-a7f1-730c4b7360da tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:34.571115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a1fd6b83-4ee5-4227-a7f1-730c4b7360da tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:34.577827 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1fd6b83-4ee5-4227-a7f1-730c4b7360da tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.578309 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1fd6b83-4ee5-4227-a7f1-730c4b7360da tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.578737 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1fd6b83-4ee5-4227-a7f1-730c4b7360da tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.579432 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1fd6b83-4ee5-4227-a7f1-730c4b7360da tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.579878 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1fd6b83-4ee5-4227-a7f1-730c4b7360da tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.580292 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1fd6b83-4ee5-4227-a7f1-730c4b7360da tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.722958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a1fd6b83-4ee5-4227-a7f1-730c4b7360da tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:34.732030 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a1fd6b83-4ee5-4227-a7f1-730c4b7360da tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1677 microversion: 2.1 time: 0.166466 Aug 24 10:20:34.736446 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 227/455] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:34 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:34.736573 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:34.744692 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2e6f886a-0623-43fd-a820-80dbf03ee4cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:34.745001 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:34.745856 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2e6f886a-0623-43fd-a820-80dbf03ee4cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:34.746898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:34.748144 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a27c1d7b-fe81-444e-96e6-4dd5783d32a6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1753 microversion: 2.20 time: 0.271822 Aug 24 10:20:34.748765 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 229/456] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:34 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1753 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:34.753020 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e6f886a-0623-43fd-a820-80dbf03ee4cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.753576 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e6f886a-0623-43fd-a820-80dbf03ee4cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.754077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e6f886a-0623-43fd-a820-80dbf03ee4cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.755020 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e6f886a-0623-43fd-a820-80dbf03ee4cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:34.755549 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e6f886a-0623-43fd-a820-80dbf03ee4cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:34.756319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e6f886a-0623-43fd-a820-80dbf03ee4cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:34.918530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2e6f886a-0623-43fd-a820-80dbf03ee4cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:34.925680 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2e6f886a-0623-43fd-a820-80dbf03ee4cc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.191296 Aug 24 10:20:34.952698 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 228/457] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:34 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:34.988291 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-b1aa659b-a5fe-4bd5-849d-60d68856e6f7 req-7db86fc3-4dfc-4d40-ba6a-0ec88ddce406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf8b275-61d0-49c9-8d08-c9aba96f38af", "name": "network-vif-deleted", "tag": "3fac9a91-cee7-4983-91cf-b5bdb6470420"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:35.001101 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-b1aa659b-a5fe-4bd5-849d-60d68856e6f7 req-7db86fc3-4dfc-4d40-ba6a-0ec88ddce406 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:35.001870 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-b1aa659b-a5fe-4bd5-849d-60d68856e6f7 req-7db86fc3-4dfc-4d40-ba6a-0ec88ddce406 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:35.002499 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-b1aa659b-a5fe-4bd5-849d-60d68856e6f7 req-7db86fc3-4dfc-4d40-ba6a-0ec88ddce406 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:35.014939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-b1aa659b-a5fe-4bd5-849d-60d68856e6f7 req-7db86fc3-4dfc-4d40-ba6a-0ec88ddce406 service nova] Creating event network-vif-deleted:3fac9a91-cee7-4983-91cf-b5bdb6470420 for instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af on hv-cinder-85427 Aug 24 10:20:35.020731 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-b1aa659b-a5fe-4bd5-849d-60d68856e6f7 req-7db86fc3-4dfc-4d40-ba6a-0ec88ddce406 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036180 Aug 24 10:20:35.022499 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 230/458] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:35.279265 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-36e37e3a-959a-4895-95c8-a084c8b9b6f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:35.280930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-36e37e3a-959a-4895-95c8-a084c8b9b6f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:35.287653 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36e37e3a-959a-4895-95c8-a084c8b9b6f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:35.288717 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36e37e3a-959a-4895-95c8-a084c8b9b6f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:35.289826 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36e37e3a-959a-4895-95c8-a084c8b9b6f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:35.291200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36e37e3a-959a-4895-95c8-a084c8b9b6f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:35.292047 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36e37e3a-959a-4895-95c8-a084c8b9b6f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:35.293161 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36e37e3a-959a-4895-95c8-a084c8b9b6f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:35.385595 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-36e37e3a-959a-4895-95c8-a084c8b9b6f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:35.393741 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-36e37e3a-959a-4895-95c8-a084c8b9b6f2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 200 len: 1327 microversion: 2.1 time: 0.123907 Aug 24 10:20:35.394469 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 229/459] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:35 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:35.757562 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a2b68e0c-1475-400b-b9f9-6ad15d265ebc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:35.759020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a2b68e0c-1475-400b-b9f9-6ad15d265ebc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:35.776183 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:35.776797 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:35.782572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2b68e0c-1475-400b-b9f9-6ad15d265ebc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:35.783090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2b68e0c-1475-400b-b9f9-6ad15d265ebc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:35.783530 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2b68e0c-1475-400b-b9f9-6ad15d265ebc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:35.787494 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2b68e0c-1475-400b-b9f9-6ad15d265ebc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:35.787985 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2b68e0c-1475-400b-b9f9-6ad15d265ebc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:35.788394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2b68e0c-1475-400b-b9f9-6ad15d265ebc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:35.790368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:35.790843 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:35.791272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:35.794348 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:35.794817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:35.795251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:35.803417 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:35.968890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:35.978512 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:35.980183 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:35.981430 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a900420f-5841-4a21-a64a-4fed263af215 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.210202 Aug 24 10:20:35.981985 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 230/460] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:35 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:35.982530 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a2b68e0c-1475-400b-b9f9-6ad15d265ebc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:35.989269 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-74b5787f-9a3a-46a1-a166-e5605c53702c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:35.990494 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-74b5787f-9a3a-46a1-a166-e5605c53702c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:35.996807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a2b68e0c-1475-400b-b9f9-6ad15d265ebc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1677 microversion: 2.1 time: 0.244816 Aug 24 10:20:35.997880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 231/461] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:35 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:35.998811 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74b5787f-9a3a-46a1-a166-e5605c53702c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:35.999326 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74b5787f-9a3a-46a1-a166-e5605c53702c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:35.999801 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74b5787f-9a3a-46a1-a166-e5605c53702c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:36.000514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74b5787f-9a3a-46a1-a166-e5605c53702c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:36.001009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74b5787f-9a3a-46a1-a166-e5605c53702c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:36.001590 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74b5787f-9a3a-46a1-a166-e5605c53702c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:36.168609 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-74b5787f-9a3a-46a1-a166-e5605c53702c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:36.179839 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-74b5787f-9a3a-46a1-a166-e5605c53702c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.195119 Aug 24 10:20:36.180908 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 231/462] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:35 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:36.415287 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:36.415897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:36.425936 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:36.426517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:36.427122 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:36.428317 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:36.428888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:36.429377 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:36.445830 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af HTTP/1.1 Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:20:36.447520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:20:36.451807 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '3bf8b275-61d0-49c9-8d08-c9aba96f38af'} Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:36.453198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:20:36.454638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:36.455952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:36.455952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-46feffd2-b7c1-42ec-8197-6a871c95306a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 404 len: 111 microversion: 2.1 time: 0.037670 Aug 24 10:20:36.455952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 232/463] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:36 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:20:36.458451 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bd458efc-1576-46da-8604-ad8b9e188fde tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '.version_select at 0x7f0af410b0d0>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:36.562409 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bd458efc-1576-46da-8604-ad8b9e188fde tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333985081" status: 202 len: 0 microversion: 2.1 time: 0.107733 Aug 24 10:20:36.563080 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 232/464] 10.222.0.30 () {58 vars in 1221 bytes} [Wed Aug 24 10:20:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333985081 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:20:37.008289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:37.009128 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:37.018858 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:37.020113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c2b88e87-7465-4f1c-aff4-191818496976 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:37.020634 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:37.022121 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c2b88e87-7465-4f1c-aff4-191818496976 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:37.022999 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:37.023754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:37.025135 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:37.025928 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:37.035442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c2b88e87-7465-4f1c-aff4-191818496976 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:37.038640 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c2b88e87-7465-4f1c-aff4-191818496976 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:37.039196 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c2b88e87-7465-4f1c-aff4-191818496976 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:37.040939 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c2b88e87-7465-4f1c-aff4-191818496976 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:37.041490 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c2b88e87-7465-4f1c-aff4-191818496976 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:37.041987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c2b88e87-7465-4f1c-aff4-191818496976 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:37.224491 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:37.233783 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:37.235327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:37.236526 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5776b8ed-3da7-4154-8350-0b96d98491af tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.232965 Aug 24 10:20:37.237111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 233/465] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:37 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:37.245350 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-76bd184a-29b4-4837-8982-ab6d7356ea34 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:37.246245 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-76bd184a-29b4-4837-8982-ab6d7356ea34 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:37.252783 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76bd184a-29b4-4837-8982-ab6d7356ea34 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:37.253603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76bd184a-29b4-4837-8982-ab6d7356ea34 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:37.254142 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76bd184a-29b4-4837-8982-ab6d7356ea34 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:37.254966 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76bd184a-29b4-4837-8982-ab6d7356ea34 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:37.255458 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76bd184a-29b4-4837-8982-ab6d7356ea34 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:37.256966 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76bd184a-29b4-4837-8982-ab6d7356ea34 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:37.276874 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c2b88e87-7465-4f1c-aff4-191818496976 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:37.281201 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:37.290255 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c2b88e87-7465-4f1c-aff4-191818496976 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1677 microversion: 2.1 time: 0.271448 Aug 24 10:20:37.293014 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 233/466] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:37 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1677 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:37.498356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-76bd184a-29b4-4837-8982-ab6d7356ea34 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:37.516422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0a2ed5b9-d343-4be7-a641-41be6650558f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: .version_select at 0x7f0af410bee0>, body: {"keypair": {"name": "tempest-keypair-899402285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+MV9mKKJLROmHJkb+UPLW27qlZRb1pZjKlSztxmHe9iQQchTwLTIVkGn0YiXJvfuK1BWrbg1TMcxv7eFozaT2sJYwXdqTF1pyvVnxhG4OH5L+IKQXCi939d78udrULDQ=="}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:37.529579 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-76bd184a-29b4-4837-8982-ab6d7356ea34 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.291367 Aug 24 10:20:37.530821 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 234/467] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:37 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:37.542184 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-0a2ed5b9-d343-4be7-a641-41be6650558f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for project 8824664cdd104c308141264985a547a1. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:37.546372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-0a2ed5b9-d343-4be7-a641-41be6650558f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for user c94c65ae14e94796a3b3bd0bb29a91b9 and project 8824664cdd104c308141264985a547a1. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:37.688015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0a2ed5b9-d343-4be7-a641-41be6650558f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176206 Aug 24 10:20:37.688662 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 234/468] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Aug 24 10:20:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:38.264717 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:38.265961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:38.277625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:38.285440 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:38.286217 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:38.287414 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:38.288091 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:38.288747 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:38.317359 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d503836b-2b67-41fd-ad17-fe0fde528ecf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:38.319404 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d503836b-2b67-41fd-ad17-fe0fde528ecf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:38.327452 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d503836b-2b67-41fd-ad17-fe0fde528ecf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:38.327941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d503836b-2b67-41fd-ad17-fe0fde528ecf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:38.328412 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d503836b-2b67-41fd-ad17-fe0fde528ecf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:38.329559 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d503836b-2b67-41fd-ad17-fe0fde528ecf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:38.330500 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d503836b-2b67-41fd-ad17-fe0fde528ecf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:38.331487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d503836b-2b67-41fd-ad17-fe0fde528ecf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:38.611888 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d503836b-2b67-41fd-ad17-fe0fde528ecf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:38.620562 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:38.621705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d503836b-2b67-41fd-ad17-fe0fde528ecf tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1677 microversion: 2.1 time: 0.309327 Aug 24 10:20:38.633345 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 235/469] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:38 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1677 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:38.641635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-49dca1cd-3a3c-4cbb-b44d-c6d8179a1fc0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:38.677060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:38.677239 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-49dca1cd-3a3c-4cbb-b44d-c6d8179a1fc0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:38.677326 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:38.677326 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f57f3938-1618-4cf5-98ad-847551b987fc tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.384527 Aug 24 10:20:38.677326 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 235/470] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:38 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:38.677622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-49dca1cd-3a3c-4cbb-b44d-c6d8179a1fc0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:38.677622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-49dca1cd-3a3c-4cbb-b44d-c6d8179a1fc0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:38.677622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-49dca1cd-3a3c-4cbb-b44d-c6d8179a1fc0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:38.677622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-49dca1cd-3a3c-4cbb-b44d-c6d8179a1fc0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:38.677893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-49dca1cd-3a3c-4cbb-b44d-c6d8179a1fc0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:38.677893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-49dca1cd-3a3c-4cbb-b44d-c6d8179a1fc0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:38.858217 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-49dca1cd-3a3c-4cbb-b44d-c6d8179a1fc0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:38.896658 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-49dca1cd-3a3c-4cbb-b44d-c6d8179a1fc0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.249512 Aug 24 10:20:38.899953 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 236/471] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:38 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:39.663824 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-33def1e6-e7f3-42dd-a862-59483d1d102a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:39.665132 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-33def1e6-e7f3-42dd-a862-59483d1d102a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:39.673168 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33def1e6-e7f3-42dd-a862-59483d1d102a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:39.674886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33def1e6-e7f3-42dd-a862-59483d1d102a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:39.675480 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33def1e6-e7f3-42dd-a862-59483d1d102a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:39.680606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33def1e6-e7f3-42dd-a862-59483d1d102a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:39.681397 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33def1e6-e7f3-42dd-a862-59483d1d102a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:39.682546 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33def1e6-e7f3-42dd-a862-59483d1d102a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:39.699614 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:39.701082 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:39.712256 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:39.712986 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:39.713408 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:39.714130 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:39.714580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:39.715005 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:40.001765 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:40.016039 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:40.018302 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:40.019853 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d91c8cec-9140-4c1b-bee3-acd80638459a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.323856 Aug 24 10:20:40.041122 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 237/472] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:39 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:40.050367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-33def1e6-e7f3-42dd-a862-59483d1d102a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:40.060305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-33def1e6-e7f3-42dd-a862-59483d1d102a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1677 microversion: 2.1 time: 0.416353 Aug 24 10:20:40.062482 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 236/473] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:39 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1677 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:40.063892 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c4237875-33ce-4d6e-afa0-0110adf6e823 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:40.064692 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c4237875-33ce-4d6e-afa0-0110adf6e823 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:40.071864 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4237875-33ce-4d6e-afa0-0110adf6e823 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:40.072570 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4237875-33ce-4d6e-afa0-0110adf6e823 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:40.073210 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4237875-33ce-4d6e-afa0-0110adf6e823 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:40.074247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4237875-33ce-4d6e-afa0-0110adf6e823 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:40.074856 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4237875-33ce-4d6e-afa0-0110adf6e823 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:40.075519 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4237875-33ce-4d6e-afa0-0110adf6e823 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:40.305607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c4237875-33ce-4d6e-afa0-0110adf6e823 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:40.317651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c4237875-33ce-4d6e-afa0-0110adf6e823 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.272897 Aug 24 10:20:40.322906 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 238/474] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:40 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:41.061491 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:41.063489 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:41.085034 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-279d233f-e0df-48ec-adf9-1a3d07c2f391 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:41.086334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-279d233f-e0df-48ec-adf9-1a3d07c2f391 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:41.091541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.097289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.097289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.097289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.103223 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.104825 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.112682 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-279d233f-e0df-48ec-adf9-1a3d07c2f391 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.114075 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-279d233f-e0df-48ec-adf9-1a3d07c2f391 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.117297 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-279d233f-e0df-48ec-adf9-1a3d07c2f391 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.119218 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-279d233f-e0df-48ec-adf9-1a3d07c2f391 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.134702 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-279d233f-e0df-48ec-adf9-1a3d07c2f391 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.137367 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-279d233f-e0df-48ec-adf9-1a3d07c2f391 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.519010 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:41.544547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:41.558600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:41.558600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-92a93983-e280-485f-a978-f46e39e371ed tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.500061 Aug 24 10:20:41.558600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 237/475] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:41 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:41.569458 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d4fb6703-01c7-4452-807f-098c4d8852ac tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:41.571211 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d4fb6703-01c7-4452-807f-098c4d8852ac tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:41.581075 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d4fb6703-01c7-4452-807f-098c4d8852ac tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.581786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d4fb6703-01c7-4452-807f-098c4d8852ac tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.582436 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d4fb6703-01c7-4452-807f-098c4d8852ac tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.583305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d4fb6703-01c7-4452-807f-098c4d8852ac tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:41.584025 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d4fb6703-01c7-4452-807f-098c4d8852ac tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:41.584677 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d4fb6703-01c7-4452-807f-098c4d8852ac tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:41.688127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-279d233f-e0df-48ec-adf9-1a3d07c2f391 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:41.712886 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-279d233f-e0df-48ec-adf9-1a3d07c2f391 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1677 microversion: 2.1 time: 0.623128 Aug 24 10:20:41.721193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 239/476] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:41 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1677 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:41.891953 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d4fb6703-01c7-4452-807f-098c4d8852ac tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:41.902779 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d4fb6703-01c7-4452-807f-098c4d8852ac tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.353515 Aug 24 10:20:41.903989 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 238/477] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:41 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:42.366466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-620539", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd93ff68-1984-453a-90ae-b4e36ac7c98e"}], "security_groups": [{"name": "tempest-securitygroup--566100119"}], "key_name": "tempest-keypair-899402285", "user_data": "}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:42.516834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.network.neutron [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] validate_networks() for [('cd93ff68-1984-453a-90ae-b4e36ac7c98e', None, None, None, None, None)] {{(pid=121271) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:20:42.577656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:42.578270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:42.587730 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:42.588495 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:42.589259 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:42.590488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:42.591106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:42.591840 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:42.896841 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:42.910829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:42.913378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:42.914848 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6e8b7893-826f-44bd-be08-170738074d13 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.341201 Aug 24 10:20:42.921315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 239/478] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:42 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:42.927075 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-215add59-e3c6-4f32-acf3-c5827337e27c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:42.939616 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-215add59-e3c6-4f32-acf3-c5827337e27c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:42.949023 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-215add59-e3c6-4f32-acf3-c5827337e27c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:42.949609 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-215add59-e3c6-4f32-acf3-c5827337e27c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:42.950124 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-215add59-e3c6-4f32-acf3-c5827337e27c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:42.950872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-215add59-e3c6-4f32-acf3-c5827337e27c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:42.951326 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-215add59-e3c6-4f32-acf3-c5827337e27c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:42.951826 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-215add59-e3c6-4f32-acf3-c5827337e27c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.229889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-215add59-e3c6-4f32-acf3-c5827337e27c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:43.242966 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-215add59-e3c6-4f32-acf3-c5827337e27c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1654 microversion: 2.1 time: 0.320243 Aug 24 10:20:43.248689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 240/479] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:42 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1654 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:43.277511 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0ec1f0b4-ce23-4076-9610-f0ed37960440 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:43.287861 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0ec1f0b4-ce23-4076-9610-f0ed37960440 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:43.314468 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0ec1f0b4-ce23-4076-9610-f0ed37960440 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.322523 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0ec1f0b4-ce23-4076-9610-f0ed37960440 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.323273 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0ec1f0b4-ce23-4076-9610-f0ed37960440 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.330270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0ec1f0b4-ce23-4076-9610-f0ed37960440 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.330969 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Flavor limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:20:43.331396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Image limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:20:43.331652 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0ec1f0b4-ce23-4076-9610-f0ed37960440 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.332237 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0ec1f0b4-ce23-4076-9610-f0ed37960440 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.334453 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Flavor pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:20:43.335433 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Image pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:20:43.336079 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:20:43.354897 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.354897 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.354897 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.354897 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.355310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.355310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.375960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for project 8824664cdd104c308141264985a547a1. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:43.382496 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for user c94c65ae14e94796a3b3bd0bb29a91b9 and project 8824664cdd104c308141264985a547a1. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:43.400742 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Going to run 1 instances... {{(pid=121271) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:20:43.404239 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:20:43.625839 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-039fac6d-5603-4e22-8fc9-000ae0fe7760 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.270682 Aug 24 10:20:43.628401 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 240/480] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:20:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:20:43.655997 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e0b13882-ce33-44c0-9659-01dc33e52ffa tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:43.670959 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0b13882-ce33-44c0-9659-01dc33e52ffa tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.671559 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0b13882-ce33-44c0-9659-01dc33e52ffa tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.672082 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e0b13882-ce33-44c0-9659-01dc33e52ffa tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.703587 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e0b13882-ce33-44c0-9659-01dc33e52ffa tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Going to try to start instance {{(pid=121271) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 10:20:43.793496 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0ec1f0b4-ce23-4076-9610-f0ed37960440 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:43.806436 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0ec1f0b4-ce23-4076-9610-f0ed37960440 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.555994 Aug 24 10:20:43.819977 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 241/481] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:43 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:43.826901 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8ef52070-8b14-43c7-8f5c-7c7852a94070 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:43.827784 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8ef52070-8b14-43c7-8f5c-7c7852a94070 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:43.930295 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e0b13882-ce33-44c0-9659-01dc33e52ffa tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/action" status: 202 len: 0 microversion: 2.1 time: 0.299664 Aug 24 10:20:43.934757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 241/482] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:20:43 2022] POST /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:20:43.940399 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7dce7b7d-0d6c-42f2-8e14-740c9dfc9bf5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:43.941153 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7dce7b7d-0d6c-42f2-8e14-740c9dfc9bf5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:43.965108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7dce7b7d-0d6c-42f2-8e14-740c9dfc9bf5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.975224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7dce7b7d-0d6c-42f2-8e14-740c9dfc9bf5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.975931 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7dce7b7d-0d6c-42f2-8e14-740c9dfc9bf5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:43.976827 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7dce7b7d-0d6c-42f2-8e14-740c9dfc9bf5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:43.977337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7dce7b7d-0d6c-42f2-8e14-740c9dfc9bf5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:43.978079 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7dce7b7d-0d6c-42f2-8e14-740c9dfc9bf5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.001006 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8ef52070-8b14-43c7-8f5c-7c7852a94070 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:44.008525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8ef52070-8b14-43c7-8f5c-7c7852a94070 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1237 microversion: 2.1 time: 0.186381 Aug 24 10:20:44.013250 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 242/483] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:43 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1237 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:44.037933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:44.041965 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:44.068047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.069985 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.071772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.074119 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.076097 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.080615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.377693 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7dce7b7d-0d6c-42f2-8e14-740c9dfc9bf5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:44.399711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7dce7b7d-0d6c-42f2-8e14-740c9dfc9bf5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1663 microversion: 2.1 time: 0.463637 Aug 24 10:20:44.400803 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 242/484] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:43 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1663 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:44.461123 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:44.472906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:44.478582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:44.478582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a2ac3a30-39ca-4a7d-8d9e-5da0f3777605 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.462389 Aug 24 10:20:44.478582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 243/485] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:44 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:44.833296 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0207d211-fe5c-4357-930e-48debbbdb978 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:44.833449 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0207d211-fe5c-4357-930e-48debbbdb978 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:44.842922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0207d211-fe5c-4357-930e-48debbbdb978 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.848471 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0207d211-fe5c-4357-930e-48debbbdb978 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.849363 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0207d211-fe5c-4357-930e-48debbbdb978 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:44.850715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0207d211-fe5c-4357-930e-48debbbdb978 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:44.856982 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0207d211-fe5c-4357-930e-48debbbdb978 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:44.857715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0207d211-fe5c-4357-930e-48debbbdb978 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.041076 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0221b2d0-e4ee-4cf8-a507-4370f80216a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:45.041076 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0221b2d0-e4ee-4cf8-a507-4370f80216a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:45.050549 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0221b2d0-e4ee-4cf8-a507-4370f80216a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.051132 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0221b2d0-e4ee-4cf8-a507-4370f80216a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.051630 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0221b2d0-e4ee-4cf8-a507-4370f80216a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.058219 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0221b2d0-e4ee-4cf8-a507-4370f80216a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.060822 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0221b2d0-e4ee-4cf8-a507-4370f80216a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.061296 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0221b2d0-e4ee-4cf8-a507-4370f80216a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.203190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0207d211-fe5c-4357-930e-48debbbdb978 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:45.214811 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0207d211-fe5c-4357-930e-48debbbdb978 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.388011 Aug 24 10:20:45.231717 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 243/486] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:44 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:45.432394 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-fbaa49ac-cb34-4652-9bf6-e4a8ba0b86f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:45.437902 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-fbaa49ac-cb34-4652-9bf6-e4a8ba0b86f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:45.442332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbaa49ac-cb34-4652-9bf6-e4a8ba0b86f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.444505 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbaa49ac-cb34-4652-9bf6-e4a8ba0b86f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.445490 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbaa49ac-cb34-4652-9bf6-e4a8ba0b86f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.447560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbaa49ac-cb34-4652-9bf6-e4a8ba0b86f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.450408 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbaa49ac-cb34-4652-9bf6-e4a8ba0b86f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.451522 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbaa49ac-cb34-4652-9bf6-e4a8ba0b86f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.518821 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0221b2d0-e4ee-4cf8-a507-4370f80216a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:45.544175 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0221b2d0-e4ee-4cf8-a507-4370f80216a4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1241 microversion: 2.1 time: 0.506787 Aug 24 10:20:45.547138 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 244/487] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:45 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1241 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:45.566686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:45.568014 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:45.603224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.604979 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.606136 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.607495 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:45.608754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:45.611127 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:45.825783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fbaa49ac-cb34-4652-9bf6-e4a8ba0b86f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:45.842199 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-fbaa49ac-cb34-4652-9bf6-e4a8ba0b86f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1663 microversion: 2.1 time: 0.423337 Aug 24 10:20:45.844028 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 244/488] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:45 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1663 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:46.127633 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:46.136803 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:46.138635 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:46.140057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6fbc0d77-963c-4be2-9707-8d01bbd2e065 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.589741 Aug 24 10:20:46.141050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 245/489] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:45 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:46.244455 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2b0789df-0352-49ae-8023-84454721e4fc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.245405 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2b0789df-0352-49ae-8023-84454721e4fc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:46.254336 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b0789df-0352-49ae-8023-84454721e4fc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.255211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b0789df-0352-49ae-8023-84454721e4fc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.256361 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b0789df-0352-49ae-8023-84454721e4fc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.257563 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b0789df-0352-49ae-8023-84454721e4fc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.258270 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b0789df-0352-49ae-8023-84454721e4fc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.260238 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b0789df-0352-49ae-8023-84454721e4fc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.452421 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2b0789df-0352-49ae-8023-84454721e4fc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:46.463532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2b0789df-0352-49ae-8023-84454721e4fc tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.225565 Aug 24 10:20:46.464492 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 245/490] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:46 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:46.574473 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-406f1df0-31c2-4b92-a263-3d7ecdfb5a6c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.575455 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-406f1df0-31c2-4b92-a263-3d7ecdfb5a6c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:46.582524 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-406f1df0-31c2-4b92-a263-3d7ecdfb5a6c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.583092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-406f1df0-31c2-4b92-a263-3d7ecdfb5a6c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.583639 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-406f1df0-31c2-4b92-a263-3d7ecdfb5a6c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.584438 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-406f1df0-31c2-4b92-a263-3d7ecdfb5a6c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.585265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-406f1df0-31c2-4b92-a263-3d7ecdfb5a6c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.585361 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-406f1df0-31c2-4b92-a263-3d7ecdfb5a6c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.658270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-406f1df0-31c2-4b92-a263-3d7ecdfb5a6c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:46.667990 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-406f1df0-31c2-4b92-a263-3d7ecdfb5a6c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1289 microversion: 2.1 time: 0.097422 Aug 24 10:20:46.668974 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 246/491] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:46 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:46.866438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a1e37d34-7c7a-47db-b9ed-873159768eb8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:46.867819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a1e37d34-7c7a-47db-b9ed-873159768eb8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:46.876410 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1e37d34-7c7a-47db-b9ed-873159768eb8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.877889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1e37d34-7c7a-47db-b9ed-873159768eb8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.879335 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1e37d34-7c7a-47db-b9ed-873159768eb8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:46.880939 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1e37d34-7c7a-47db-b9ed-873159768eb8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:46.881725 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1e37d34-7c7a-47db-b9ed-873159768eb8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:46.886510 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a1e37d34-7c7a-47db-b9ed-873159768eb8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.112836 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a1e37d34-7c7a-47db-b9ed-873159768eb8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.122907 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a1e37d34-7c7a-47db-b9ed-873159768eb8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1663 microversion: 2.1 time: 0.261141 Aug 24 10:20:47.123879 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 246/492] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:46 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1663 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:47.166628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:47.167364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:47.185095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.185095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.193855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.194814 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.195367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.195950 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.440422 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.450869 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.452620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.454160 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5f7cda2e-e462-4256-8efa-1d61d0b7921a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.292843 Aug 24 10:20:47.455439 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 247/493] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:47 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:47.486174 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4c2f78f8-5f7e-4c24-ae41-3d3276930d6b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:47.487508 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4c2f78f8-5f7e-4c24-ae41-3d3276930d6b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:47.494472 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:47.496600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4c2f78f8-5f7e-4c24-ae41-3d3276930d6b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.497533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4c2f78f8-5f7e-4c24-ae41-3d3276930d6b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.498158 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4c2f78f8-5f7e-4c24-ae41-3d3276930d6b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.499131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4c2f78f8-5f7e-4c24-ae41-3d3276930d6b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.499784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4c2f78f8-5f7e-4c24-ae41-3d3276930d6b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.500405 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4c2f78f8-5f7e-4c24-ae41-3d3276930d6b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.657676 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4c2f78f8-5f7e-4c24-ae41-3d3276930d6b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.667354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4c2f78f8-5f7e-4c24-ae41-3d3276930d6b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.185865 Aug 24 10:20:47.668192 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 247/494] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:47 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:47.695372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c48c9f51-4ab6-4490-8bc0-98d027545683 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:47.696238 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c48c9f51-4ab6-4490-8bc0-98d027545683 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:47.705148 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c48c9f51-4ab6-4490-8bc0-98d027545683 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.707516 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c48c9f51-4ab6-4490-8bc0-98d027545683 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.711652 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c48c9f51-4ab6-4490-8bc0-98d027545683 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.712506 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c48c9f51-4ab6-4490-8bc0-98d027545683 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:47.713073 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c48c9f51-4ab6-4490-8bc0-98d027545683 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:47.713590 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c48c9f51-4ab6-4490-8bc0-98d027545683 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:47.781470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c48c9f51-4ab6-4490-8bc0-98d027545683 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:47.789657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c48c9f51-4ab6-4490-8bc0-98d027545683 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1289 microversion: 2.1 time: 0.099158 Aug 24 10:20:47.790239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 248/495] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:47 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:48.147982 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f020d4be-3b53-43b4-a528-2c10620082a2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:48.148619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f020d4be-3b53-43b4-a528-2c10620082a2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:48.154974 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f020d4be-3b53-43b4-a528-2c10620082a2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.155453 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f020d4be-3b53-43b4-a528-2c10620082a2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.155915 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f020d4be-3b53-43b4-a528-2c10620082a2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.156601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f020d4be-3b53-43b4-a528-2c10620082a2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.157078 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f020d4be-3b53-43b4-a528-2c10620082a2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.157721 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f020d4be-3b53-43b4-a528-2c10620082a2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.319315 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f020d4be-3b53-43b4-a528-2c10620082a2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:48.327137 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f020d4be-3b53-43b4-a528-2c10620082a2 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1663 microversion: 2.1 time: 0.184519 Aug 24 10:20:48.327707 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 248/496] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:48 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:48.482112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:48.482741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:48.489537 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.490612 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.491041 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.491850 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.492306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.492736 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.507841 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:48.696009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f62c8816-bea3-49e4-baeb-c82089e8e4b7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:48.697460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f62c8816-bea3-49e4-baeb-c82089e8e4b7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:48.705634 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f62c8816-bea3-49e4-baeb-c82089e8e4b7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.706437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f62c8816-bea3-49e4-baeb-c82089e8e4b7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.706973 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f62c8816-bea3-49e4-baeb-c82089e8e4b7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.707613 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f62c8816-bea3-49e4-baeb-c82089e8e4b7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.708079 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f62c8816-bea3-49e4-baeb-c82089e8e4b7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.709165 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f62c8816-bea3-49e4-baeb-c82089e8e4b7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.717444 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:48.727909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:48.729497 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:48.730909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-33122377-47bb-455f-84b9-be4fd149331d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.253076 Aug 24 10:20:48.731661 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 249/497] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:48 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:48.812168 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e7e1d2d5-093a-4375-a31f-44fb40e8ae17 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:48.813034 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-e7e1d2d5-093a-4375-a31f-44fb40e8ae17 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:48.821753 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e7e1d2d5-093a-4375-a31f-44fb40e8ae17 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.822607 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e7e1d2d5-093a-4375-a31f-44fb40e8ae17 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.823037 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e7e1d2d5-093a-4375-a31f-44fb40e8ae17 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.824280 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e7e1d2d5-093a-4375-a31f-44fb40e8ae17 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:48.824799 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e7e1d2d5-093a-4375-a31f-44fb40e8ae17 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:48.825247 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e7e1d2d5-093a-4375-a31f-44fb40e8ae17 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:48.898591 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e7e1d2d5-093a-4375-a31f-44fb40e8ae17 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:48.917190 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e7e1d2d5-093a-4375-a31f-44fb40e8ae17 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1289 microversion: 2.1 time: 0.109791 Aug 24 10:20:48.930970 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 250/498] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:48 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:48.940742 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f62c8816-bea3-49e4-baeb-c82089e8e4b7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:48.966415 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f62c8816-bea3-49e4-baeb-c82089e8e4b7 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.278873 Aug 24 10:20:48.967627 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 249/499] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:48 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:49.349831 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9862d6ae-3e83-4abc-bda7-51cc3497b610 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:49.362378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9862d6ae-3e83-4abc-bda7-51cc3497b610 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:49.362378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9862d6ae-3e83-4abc-bda7-51cc3497b610 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.362378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9862d6ae-3e83-4abc-bda7-51cc3497b610 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.362378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9862d6ae-3e83-4abc-bda7-51cc3497b610 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:49.362957 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9862d6ae-3e83-4abc-bda7-51cc3497b610 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.362957 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9862d6ae-3e83-4abc-bda7-51cc3497b610 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.362957 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9862d6ae-3e83-4abc-bda7-51cc3497b610 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:49.517032 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9862d6ae-3e83-4abc-bda7-51cc3497b610 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:49.527071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9862d6ae-3e83-4abc-bda7-51cc3497b610 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1663 microversion: 2.1 time: 0.181765 Aug 24 10:20:49.529010 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 251/500] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:49 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1663 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:49.754630 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:49.756506 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:49.763576 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.764059 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.764504 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:49.765226 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.765679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.766105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:49.947827 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6806e2c1-cfb0-4187-9872-0a84fa75957d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:49.948467 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6806e2c1-cfb0-4187-9872-0a84fa75957d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:49.972432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6806e2c1-cfb0-4187-9872-0a84fa75957d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.977962 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6806e2c1-cfb0-4187-9872-0a84fa75957d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.978470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6806e2c1-cfb0-4187-9872-0a84fa75957d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:49.980792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6806e2c1-cfb0-4187-9872-0a84fa75957d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:49.982298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6806e2c1-cfb0-4187-9872-0a84fa75957d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:49.984328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6806e2c1-cfb0-4187-9872-0a84fa75957d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:50.014247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:50.025333 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:50.030725 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:50.043418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-698b1c2f-cc84-4161-92a5-b278856b87c7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.284573 Aug 24 10:20:50.044669 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 250/501] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:49 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:50.068973 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-97b35ec5-62e4-4467-83cf-5a00447689bd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:50.069616 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-97b35ec5-62e4-4467-83cf-5a00447689bd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:50.078011 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97b35ec5-62e4-4467-83cf-5a00447689bd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:50.078644 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97b35ec5-62e4-4467-83cf-5a00447689bd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:50.079169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97b35ec5-62e4-4467-83cf-5a00447689bd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:50.079997 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97b35ec5-62e4-4467-83cf-5a00447689bd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:50.080550 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97b35ec5-62e4-4467-83cf-5a00447689bd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:50.081891 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97b35ec5-62e4-4467-83cf-5a00447689bd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:50.087802 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:50.164252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6806e2c1-cfb0-4187-9872-0a84fa75957d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:50.172317 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6806e2c1-cfb0-4187-9872-0a84fa75957d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1297 microversion: 2.1 time: 0.236130 Aug 24 10:20:50.173092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 252/502] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:49 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1297 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:50.355824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-97b35ec5-62e4-4467-83cf-5a00447689bd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:50.371347 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-97b35ec5-62e4-4467-83cf-5a00447689bd tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.311157 Aug 24 10:20:50.371969 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 251/503] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:50 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:50.555262 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-de72fa41-21ac-4eb9-8589-4b27685fbf7c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:50.561048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-de72fa41-21ac-4eb9-8589-4b27685fbf7c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:50.567095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de72fa41-21ac-4eb9-8589-4b27685fbf7c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:50.568657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de72fa41-21ac-4eb9-8589-4b27685fbf7c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:50.569517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de72fa41-21ac-4eb9-8589-4b27685fbf7c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:50.570830 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de72fa41-21ac-4eb9-8589-4b27685fbf7c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:50.571439 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de72fa41-21ac-4eb9-8589-4b27685fbf7c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:50.572069 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-de72fa41-21ac-4eb9-8589-4b27685fbf7c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:50.803375 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-de72fa41-21ac-4eb9-8589-4b27685fbf7c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:50.811243 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-de72fa41-21ac-4eb9-8589-4b27685fbf7c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1667 microversion: 2.1 time: 0.265495 Aug 24 10:20:50.811809 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 253/504] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:50 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1667 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:51.072562 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:51.077807 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:51.085749 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.086421 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.086871 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.087603 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.088069 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.088498 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.194681 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5227f7cc-6550-46f7-aee4-bba3256e4b0e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:51.195307 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5227f7cc-6550-46f7-aee4-bba3256e4b0e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:51.222959 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5227f7cc-6550-46f7-aee4-bba3256e4b0e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.223752 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5227f7cc-6550-46f7-aee4-bba3256e4b0e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.224432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5227f7cc-6550-46f7-aee4-bba3256e4b0e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.225398 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5227f7cc-6550-46f7-aee4-bba3256e4b0e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.226050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5227f7cc-6550-46f7-aee4-bba3256e4b0e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.226687 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5227f7cc-6550-46f7-aee4-bba3256e4b0e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.527133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5227f7cc-6550-46f7-aee4-bba3256e4b0e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:51.541608 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5227f7cc-6550-46f7-aee4-bba3256e4b0e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1362 microversion: 2.1 time: 0.350542 Aug 24 10:20:51.560553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 254/505] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:51 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:51.568888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5808b4ef-7c08-4d6a-9347-b25701753da4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:51.573046 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5808b4ef-7c08-4d6a-9347-b25701753da4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:51.573955 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:51.577960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5808b4ef-7c08-4d6a-9347-b25701753da4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.578667 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5808b4ef-7c08-4d6a-9347-b25701753da4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.579293 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5808b4ef-7c08-4d6a-9347-b25701753da4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.580202 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5808b4ef-7c08-4d6a-9347-b25701753da4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:51.581080 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5808b4ef-7c08-4d6a-9347-b25701753da4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:51.581685 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5808b4ef-7c08-4d6a-9347-b25701753da4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:51.750582 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:51.783402 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:51.787975 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:51.789494 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9d0f1710-942e-4088-b036-c9fab98d6cc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.721893 Aug 24 10:20:51.793258 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 252/506] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:51 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:51.804245 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5808b4ef-7c08-4d6a-9347-b25701753da4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:51.814987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5808b4ef-7c08-4d6a-9347-b25701753da4 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1735 microversion: 2.1 time: 0.252151 Aug 24 10:20:51.816344 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 255/507] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:51 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:52.567522 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-878d0363-821d-4de5-9d85-7eab322e7602 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:52.568908 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-878d0363-821d-4de5-9d85-7eab322e7602 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:52.575540 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-878d0363-821d-4de5-9d85-7eab322e7602 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:52.576023 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-878d0363-821d-4de5-9d85-7eab322e7602 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.576459 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-878d0363-821d-4de5-9d85-7eab322e7602 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:52.577191 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-878d0363-821d-4de5-9d85-7eab322e7602 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:52.577648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-878d0363-821d-4de5-9d85-7eab322e7602 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.578074 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-878d0363-821d-4de5-9d85-7eab322e7602 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:52.815639 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:52.816887 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:52.826324 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:52.866258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.866258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:52.866258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:52.866258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.866980 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:52.867166 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-878d0363-821d-4de5-9d85-7eab322e7602 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:52.869037 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-878d0363-821d-4de5-9d85-7eab322e7602 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1362 microversion: 2.1 time: 0.305145 Aug 24 10:20:52.870381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 253/508] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:52 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:52.876255 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6cb05448-d899-495e-b4a4-0506159bf522 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:52.877537 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-6cb05448-d899-495e-b4a4-0506159bf522 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:52.887882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6cb05448-d899-495e-b4a4-0506159bf522 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:52.889396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6cb05448-d899-495e-b4a4-0506159bf522 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.890476 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6cb05448-d899-495e-b4a4-0506159bf522 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:52.892489 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6cb05448-d899-495e-b4a4-0506159bf522 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:52.893609 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6cb05448-d899-495e-b4a4-0506159bf522 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:52.894782 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6cb05448-d899-495e-b4a4-0506159bf522 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:53.055004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:53.065287 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:53.067341 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:53.069739 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c8570bf2-01bf-4815-a799-e94d43115adb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.257818 Aug 24 10:20:53.070884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 256/509] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:52 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:20:53.129875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6cb05448-d899-495e-b4a4-0506159bf522 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:53.139334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-6cb05448-d899-495e-b4a4-0506159bf522 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1715 microversion: 2.1 time: 0.267533 Aug 24 10:20:53.140169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 254/510] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:52 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1715 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:53.345141 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:53.345141 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:53.348721 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:53.349878 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:53.350465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:53.351286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:53.351739 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:53.352421 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:53.487025 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] HTTP exception thrown: Cannot 'detach_volume' instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 while it is in vm_state rescued Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Request method failure captured: Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: DELETE /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments/ed7ef0f6-9563-4b36-96fa-aabc63dff1f3 HTTP/1.1 Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqeZL8TowYsedOYEynKAPOP9RwdHJIc2D-gELfWWCOmFE4l4co3BDidi-uSQEN7L1Eopi2D_J-scSLzQMafxChW6tVTjZzwAINMHAMdJkgGIX9f6AYn2sKPGG8VZdURC1cZvC1knKHb2lC5R8pG-zv0XHn6P3W5Q3vftEcgy2ZHOSU Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 66a7713fb6804b4db1fbd15fa71afa74 Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:20:53.489515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66a7713fb6804b4db1fbd15fa71afa74", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 66a7713fb6804b4db1fbd15fa71afa74 Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-ServerRescueNegativeTestJSON-314780275-project Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 388174c87a2245ca89a634f3b177e166 Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-ServerRescueNegativeTestJSON-314780275-project Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:20:53.491220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Cannot 'detach_volume' instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 while it is in vm_state rescued Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'server_id': 'ffa35bff-3f3e-4a84-af4f-cdb62e5a4481', 'id': 'ed7ef0f6-9563-4b36-96fa-aabc63dff1f3'} Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:20:53.492111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 while it is in vm_state rescued Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 while it is in vm_state rescued Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:20:53.493656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Returning 409 to user: Cannot 'detach_volume' instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 while it is in vm_state rescued {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:20:53.494844 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-56aa3e7d-0885-4caf-b083-dd8c4a8f90a1 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments/ed7ef0f6-9563-4b36-96fa-aabc63dff1f3" status: 409 len: 152 microversion: 2.1 time: 0.156094 Aug 24 10:20:53.494844 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 257/511] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:20:53 2022] DELETE /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments/ed7ef0f6-9563-4b36-96fa-aabc63dff1f3 => generated 152 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 10:20:53.502000 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ffd8ef57-fcce-432e-827a-db7ad8f1f5ec tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:53.502611 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ffd8ef57-fcce-432e-827a-db7ad8f1f5ec tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:53.504988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:53.506771 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=10 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:53.511691 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ffd8ef57-fcce-432e-827a-db7ad8f1f5ec tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:53.512247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ffd8ef57-fcce-432e-827a-db7ad8f1f5ec tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:53.512768 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ffd8ef57-fcce-432e-827a-db7ad8f1f5ec tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:53.513549 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ffd8ef57-fcce-432e-827a-db7ad8f1f5ec tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:53.514193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ffd8ef57-fcce-432e-827a-db7ad8f1f5ec tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:53.514714 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ffd8ef57-fcce-432e-827a-db7ad8f1f5ec tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:53.891723 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a1dcf3ad-e209-48e1-be65-76632f8b0636 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:53.892343 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a1dcf3ad-e209-48e1-be65-76632f8b0636 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:53.900059 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a1dcf3ad-e209-48e1-be65-76632f8b0636 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:53.900535 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a1dcf3ad-e209-48e1-be65-76632f8b0636 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:53.901026 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a1dcf3ad-e209-48e1-be65-76632f8b0636 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:53.901718 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a1dcf3ad-e209-48e1-be65-76632f8b0636 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:53.902172 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a1dcf3ad-e209-48e1-be65-76632f8b0636 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:53.902594 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a1dcf3ad-e209-48e1-be65-76632f8b0636 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.008139 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:54.079988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ffd8ef57-fcce-432e-827a-db7ad8f1f5ec tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "POST /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/action" status: 202 len: 0 microversion: 2.1 time: 0.581455 Aug 24 10:20:54.084048 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 255/512] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:20:53 2022] POST /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:20:54.088530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-1fd187fa-eb9c-4054-85a6-462c99d4f146 req-8f763bf9-d3af-4128-9551-d9a5075a5f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1", "tag": "a0b112d7-221f-4e33-a257-82953d4549d7"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:54.104621 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-1fd187fa-eb9c-4054-85a6-462c99d4f146 req-8f763bf9-d3af-4128-9551-d9a5075a5f9b service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.105160 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-1fd187fa-eb9c-4054-85a6-462c99d4f146 req-8f763bf9-d3af-4128-9551-d9a5075a5f9b service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.105589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-1fd187fa-eb9c-4054-85a6-462c99d4f146 req-8f763bf9-d3af-4128-9551-d9a5075a5f9b service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.115472 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a1dcf3ad-e209-48e1-be65-76632f8b0636 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:54.119180 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-1fd187fa-eb9c-4054-85a6-462c99d4f146 req-8f763bf9-d3af-4128-9551-d9a5075a5f9b service nova] Creating event network-changed:a0b112d7-221f-4e33-a257-82953d4549d7 for instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 on hv-cinder-85427 Aug 24 10:20:54.124162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a1dcf3ad-e209-48e1-be65-76632f8b0636 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1362 microversion: 2.1 time: 0.236169 Aug 24 10:20:54.124833 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-1fd187fa-eb9c-4054-85a6-462c99d4f146 req-8f763bf9-d3af-4128-9551-d9a5075a5f9b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041963 Aug 24 10:20:54.125519 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 258/513] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:53 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:54.126031 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 256/514] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:54.132875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:54.133753 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:54.134234 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-94742146-f036-4182-b417-d18f63ad88b8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:54.134995 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-94742146-f036-4182-b417-d18f63ad88b8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:54.140757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.141440 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94742146-f036-4182-b417-d18f63ad88b8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.142035 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94742146-f036-4182-b417-d18f63ad88b8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.142631 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.142752 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94742146-f036-4182-b417-d18f63ad88b8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.143329 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.143656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94742146-f036-4182-b417-d18f63ad88b8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.144233 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94742146-f036-4182-b417-d18f63ad88b8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.144626 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:54.144962 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-94742146-f036-4182-b417-d18f63ad88b8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.145513 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:54.146855 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:54.330683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-94742146-f036-4182-b417-d18f63ad88b8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:54.344071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-94742146-f036-4182-b417-d18f63ad88b8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1723 microversion: 2.1 time: 0.214209 Aug 24 10:20:54.344759 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 259/515] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:54 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:54.384402 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:54.393762 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:54.395292 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:54.396533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-91b00672-5443-47a4-b4a8-9c6649292b76 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.269301 Aug 24 10:20:54.397359 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 257/516] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:54 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:55.149192 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-54d6c34a-2c8c-4d1f-90e9-bfa4741535f3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:55.149810 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-54d6c34a-2c8c-4d1f-90e9-bfa4741535f3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:55.172885 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54d6c34a-2c8c-4d1f-90e9-bfa4741535f3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:55.174135 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54d6c34a-2c8c-4d1f-90e9-bfa4741535f3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:55.180890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54d6c34a-2c8c-4d1f-90e9-bfa4741535f3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:55.180890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54d6c34a-2c8c-4d1f-90e9-bfa4741535f3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:55.180890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54d6c34a-2c8c-4d1f-90e9-bfa4741535f3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:55.180890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54d6c34a-2c8c-4d1f-90e9-bfa4741535f3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:55.369357 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4de5f74c-2441-4ec6-9499-7f22085cbf4f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:55.370155 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4de5f74c-2441-4ec6-9499-7f22085cbf4f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:55.387078 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4de5f74c-2441-4ec6-9499-7f22085cbf4f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:55.387584 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4de5f74c-2441-4ec6-9499-7f22085cbf4f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:55.388068 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4de5f74c-2441-4ec6-9499-7f22085cbf4f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:55.388897 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4de5f74c-2441-4ec6-9499-7f22085cbf4f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:55.389365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4de5f74c-2441-4ec6-9499-7f22085cbf4f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:55.395988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4de5f74c-2441-4ec6-9499-7f22085cbf4f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:55.589910 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4de5f74c-2441-4ec6-9499-7f22085cbf4f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:55.602072 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4de5f74c-2441-4ec6-9499-7f22085cbf4f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1723 microversion: 2.1 time: 0.237548 Aug 24 10:20:55.603328 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 258/517] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:55 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:55.608321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:55.609273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:55.616817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:55.618373 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:55.619047 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:55.619992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:55.620697 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:55.621438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:55.800806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:55.812786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:55.814575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:55.822290 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-21c7f04b-1d2b-46a6-83ab-8fbc7ae059ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.211308 Aug 24 10:20:55.822290 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 259/518] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:55 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:55.943801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-54d6c34a-2c8c-4d1f-90e9-bfa4741535f3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:55.958423 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-54d6c34a-2c8c-4d1f-90e9-bfa4741535f3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1362 microversion: 2.1 time: 0.813185 Aug 24 10:20:55.973173 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 260/519] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:55 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1362 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:56.014051 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-23e33b69-63f3-44f5-a926-7f0d07c978e9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Action: 'create', calling method: .version_select at 0x7f0af4062af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1965718378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwf7X1L+Ah84IQVgfL91aP6r/L2rDesf9+tMHFiidIXQ7f66QCf63sD8PhxpTbraw5RRb+PnhNNtcyL+gllBjipAh0ncUxH2nJ+U81mmwGRGY652Yvm/e0Arv/38qsBKA=="}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:56.031040 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-23e33b69-63f3-44f5-a926-7f0d07c978e9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Getting quotas for project f2c601f7e6b64f83919d960b601e9331. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:56.035751 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-23e33b69-63f3-44f5-a926-7f0d07c978e9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Getting quotas for user c28281bb90464004a751699a49c61ebf and project f2c601f7e6b64f83919d960b601e9331. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:56.150110 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-23e33b69-63f3-44f5-a926-7f0d07c978e9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.332582 Aug 24 10:20:56.150899 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 260/520] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Aug 24 10:20:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:56.627087 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ff8bf11a-94c7-4e6d-84a8-5451f00f7284 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:56.627700 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ff8bf11a-94c7-4e6d-84a8-5451f00f7284 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:56.634628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ff8bf11a-94c7-4e6d-84a8-5451f00f7284 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:56.635105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ff8bf11a-94c7-4e6d-84a8-5451f00f7284 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:56.635545 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ff8bf11a-94c7-4e6d-84a8-5451f00f7284 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:56.636233 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ff8bf11a-94c7-4e6d-84a8-5451f00f7284 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:56.636690 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ff8bf11a-94c7-4e6d-84a8-5451f00f7284 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:56.637209 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ff8bf11a-94c7-4e6d-84a8-5451f00f7284 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:56.826590 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ff8bf11a-94c7-4e6d-84a8-5451f00f7284 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:56.836211 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ff8bf11a-94c7-4e6d-84a8-5451f00f7284 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1723 microversion: 2.1 time: 0.212964 Aug 24 10:20:56.837073 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 261/521] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:56 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:56.839950 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:56.840565 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:56.850321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:56.854772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:56.854772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:56.854772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:56.854772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:56.855200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:56.980411 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cbcc1da7-e4c7-4203-8ece-310df619e281 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:56.981077 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cbcc1da7-e4c7-4203-8ece-310df619e281 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:56.993247 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbcc1da7-e4c7-4203-8ece-310df619e281 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:56.993754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbcc1da7-e4c7-4203-8ece-310df619e281 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:56.994229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbcc1da7-e4c7-4203-8ece-310df619e281 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:56.994948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbcc1da7-e4c7-4203-8ece-310df619e281 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:56.995403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbcc1da7-e4c7-4203-8ece-310df619e281 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:56.995820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbcc1da7-e4c7-4203-8ece-310df619e281 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:57.016960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:57.035183 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:57.040799 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:57.042258 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f10080d6-90ec-4cbc-a8e4-a6bead40b5eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.206044 Aug 24 10:20:57.062165 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 261/522] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:56 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:57.157053 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cbcc1da7-e4c7-4203-8ece-310df619e281 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:57.168398 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cbcc1da7-e4c7-4203-8ece-310df619e281 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1362 microversion: 2.1 time: 0.191748 Aug 24 10:20:57.169471 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 262/523] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:56 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:57.446292 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-2d17588b-e9f5-4e8b-95f3-dcdafee63767 req-09399fdc-3d90-4b24-99bb-63d220457b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac36f3b6-c66c-406b-b472-0a2dd018d4c3", "name": "network-vif-plugged", "status": "completed", "tag": "9fdb04de-4902-4316-8683-e37dc854e2b3"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:57.456890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-2d17588b-e9f5-4e8b-95f3-dcdafee63767 req-09399fdc-3d90-4b24-99bb-63d220457b3f service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:57.459007 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-2d17588b-e9f5-4e8b-95f3-dcdafee63767 req-09399fdc-3d90-4b24-99bb-63d220457b3f service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:57.459007 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-2d17588b-e9f5-4e8b-95f3-dcdafee63767 req-09399fdc-3d90-4b24-99bb-63d220457b3f service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:57.469735 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-2d17588b-e9f5-4e8b-95f3-dcdafee63767 req-09399fdc-3d90-4b24-99bb-63d220457b3f service nova] Creating event network-vif-plugged:9fdb04de-4902-4316-8683-e37dc854e2b3 for instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 on hv-cinder-85427 Aug 24 10:20:57.474988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-2d17588b-e9f5-4e8b-95f3-dcdafee63767 req-09399fdc-3d90-4b24-99bb-63d220457b3f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034387 Aug 24 10:20:57.475583 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 262/524] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:20:57.860340 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-385b067a-0e8c-4fd6-9d2f-f9aaeba6ec96 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:57.861191 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-385b067a-0e8c-4fd6-9d2f-f9aaeba6ec96 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:57.871748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-385b067a-0e8c-4fd6-9d2f-f9aaeba6ec96 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:57.871748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-385b067a-0e8c-4fd6-9d2f-f9aaeba6ec96 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:57.871748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-385b067a-0e8c-4fd6-9d2f-f9aaeba6ec96 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:57.871748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-385b067a-0e8c-4fd6-9d2f-f9aaeba6ec96 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:57.872315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-385b067a-0e8c-4fd6-9d2f-f9aaeba6ec96 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:57.872315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-385b067a-0e8c-4fd6-9d2f-f9aaeba6ec96 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:58.037247 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-385b067a-0e8c-4fd6-9d2f-f9aaeba6ec96 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:58.046252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-385b067a-0e8c-4fd6-9d2f-f9aaeba6ec96 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1723 microversion: 2.1 time: 0.190226 Aug 24 10:20:58.046830 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 263/525] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:57 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:58.071221 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:58.071221 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:58.075362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:58.075907 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:58.076417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:58.077204 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:58.077760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:58.078399 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:58.189697 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-55f11652-3952-4c22-a129-01f2b648ac2a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:58.190540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-55f11652-3952-4c22-a129-01f2b648ac2a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:58.197405 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-55f11652-3952-4c22-a129-01f2b648ac2a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:58.197405 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-55f11652-3952-4c22-a129-01f2b648ac2a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:58.198423 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-55f11652-3952-4c22-a129-01f2b648ac2a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:58.198423 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-55f11652-3952-4c22-a129-01f2b648ac2a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:58.198801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-55f11652-3952-4c22-a129-01f2b648ac2a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:58.199221 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-55f11652-3952-4c22-a129-01f2b648ac2a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:58.269573 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:58.282790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:58.284790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:58.287055 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4d4a5d85-6b13-42b7-9094-468f9c1a01a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.222268 Aug 24 10:20:58.287734 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 263/526] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:58 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:58.409258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-55f11652-3952-4c22-a129-01f2b648ac2a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:58.417102 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-55f11652-3952-4c22-a129-01f2b648ac2a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1362 microversion: 2.1 time: 0.231128 Aug 24 10:20:58.417689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 264/527] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:58 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:20:59.073295 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-cd06406e-7d05-45a4-bb25-80a87d9373de tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:59.073934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-cd06406e-7d05-45a4-bb25-80a87d9373de tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:59.087826 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cd06406e-7d05-45a4-bb25-80a87d9373de tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:59.088060 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cd06406e-7d05-45a4-bb25-80a87d9373de tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:59.089352 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cd06406e-7d05-45a4-bb25-80a87d9373de tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:59.095513 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cd06406e-7d05-45a4-bb25-80a87d9373de tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:59.096209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cd06406e-7d05-45a4-bb25-80a87d9373de tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:59.097020 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cd06406e-7d05-45a4-bb25-80a87d9373de tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:59.253764 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-cd06406e-7d05-45a4-bb25-80a87d9373de tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:59.263777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-cd06406e-7d05-45a4-bb25-80a87d9373de tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1723 microversion: 2.1 time: 0.197129 Aug 24 10:20:59.277375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 264/528] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:59 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:59.314589 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:59.315793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:59.323677 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:59.324172 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:59.324610 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:59.325494 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:59.326148 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:59.326738 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:59.440755 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-37649923-38ab-41d1-961d-b4dca66c8aeb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:59.441572 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-37649923-38ab-41d1-961d-b4dca66c8aeb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:59.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-37649923-38ab-41d1-961d-b4dca66c8aeb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:59.452683 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-37649923-38ab-41d1-961d-b4dca66c8aeb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:59.453339 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-37649923-38ab-41d1-961d-b4dca66c8aeb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:59.454233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-37649923-38ab-41d1-961d-b4dca66c8aeb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:59.454691 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-37649923-38ab-41d1-961d-b4dca66c8aeb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:59.457579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-37649923-38ab-41d1-961d-b4dca66c8aeb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:59.481525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:59.495465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:59.497033 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:59.499163 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3f1d008d-5bdf-464b-8b25-ff648b54dc37 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.188876 Aug 24 10:20:59.500363 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 265/529] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:20:59 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:20:59.624157 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-37649923-38ab-41d1-961d-b4dca66c8aeb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:59.643851 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-37649923-38ab-41d1-961d-b4dca66c8aeb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1362 microversion: 2.1 time: 0.207985 Aug 24 10:20:59.644813 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 265/530] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:59 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:00.286780 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5dafabfe-a9d5-46e3-ba15-477f236b533e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:00.289503 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5dafabfe-a9d5-46e3-ba15-477f236b533e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:00.294029 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5dafabfe-a9d5-46e3-ba15-477f236b533e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.294626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5dafabfe-a9d5-46e3-ba15-477f236b533e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.294980 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5dafabfe-a9d5-46e3-ba15-477f236b533e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.295727 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5dafabfe-a9d5-46e3-ba15-477f236b533e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.296297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5dafabfe-a9d5-46e3-ba15-477f236b533e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.296885 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5dafabfe-a9d5-46e3-ba15-477f236b533e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.299814 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:00.444343 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5dafabfe-a9d5-46e3-ba15-477f236b533e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:00.455948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5dafabfe-a9d5-46e3-ba15-477f236b533e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1729 microversion: 2.1 time: 0.173378 Aug 24 10:21:00.456911 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 266/531] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:00 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:00.478116 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c914b57f-610e-44aa-9681-c457586058e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:00.479343 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c914b57f-610e-44aa-9681-c457586058e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:00.486153 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c914b57f-610e-44aa-9681-c457586058e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.486641 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c914b57f-610e-44aa-9681-c457586058e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.487076 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c914b57f-610e-44aa-9681-c457586058e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.487963 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c914b57f-610e-44aa-9681-c457586058e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.488833 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c914b57f-610e-44aa-9681-c457586058e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.489309 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c914b57f-610e-44aa-9681-c457586058e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.526137 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:00.526667 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:00.533641 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.534133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.534575 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.535327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.535779 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.536200 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.582392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c914b57f-610e-44aa-9681-c457586058e8 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108206 Aug 24 10:21:00.583049 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 266/532] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Aug 24 10:21:00 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:00.667238 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2c3fa7fc-e495-4392-b5e0-deca464f1389 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:00.668289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2c3fa7fc-e495-4392-b5e0-deca464f1389 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:00.679568 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c3fa7fc-e495-4392-b5e0-deca464f1389 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.680423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c3fa7fc-e495-4392-b5e0-deca464f1389 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.681668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c3fa7fc-e495-4392-b5e0-deca464f1389 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.683261 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c3fa7fc-e495-4392-b5e0-deca464f1389 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.684281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c3fa7fc-e495-4392-b5e0-deca464f1389 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.685327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c3fa7fc-e495-4392-b5e0-deca464f1389 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.731675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:00.744027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:00.746972 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:00.748619 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0fad46b5-4bd1-4904-a959-b8b2143cb5d4 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.227810 Aug 24 10:21:00.749668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 267/533] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:00 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:21:01.150346 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2c3fa7fc-e495-4392-b5e0-deca464f1389 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:01.159847 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2c3fa7fc-e495-4392-b5e0-deca464f1389 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1362 microversion: 2.1 time: 0.498560 Aug 24 10:21:01.161131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 267/534] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:00 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1362 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:01.584547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-d2d94781-a79d-4fd6-8372-0f07d5adf768 req-24aec5aa-6a4d-4864-aa85-093b73e4e98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1", "name": "network-vif-plugged", "status": "completed", "tag": "a0b112d7-221f-4e33-a257-82953d4549d7"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:01.601415 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-d2d94781-a79d-4fd6-8372-0f07d5adf768 req-24aec5aa-6a4d-4864-aa85-093b73e4e98d service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:01.601890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-d2d94781-a79d-4fd6-8372-0f07d5adf768 req-24aec5aa-6a4d-4864-aa85-093b73e4e98d service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:01.602482 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-d2d94781-a79d-4fd6-8372-0f07d5adf768 req-24aec5aa-6a4d-4864-aa85-093b73e4e98d service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:01.619040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-d2d94781-a79d-4fd6-8372-0f07d5adf768 req-24aec5aa-6a4d-4864-aa85-093b73e4e98d service nova] Creating event network-vif-plugged:a0b112d7-221f-4e33-a257-82953d4549d7 for instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 on hv-cinder-85427 Aug 24 10:21:01.633852 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-d2d94781-a79d-4fd6-8372-0f07d5adf768 req-24aec5aa-6a4d-4864-aa85-093b73e4e98d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045352 Aug 24 10:21:01.633852 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 268/535] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:01.771910 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:01.772650 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:01.779429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:01.779904 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:01.780771 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:01.781682 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:01.782136 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:01.782558 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:02.006960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:02.021930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:02.023447 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:02.024639 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-df81425a-6f75-40ed-bbde-ad7ca4035758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1809 microversion: 2.20 time: 0.256757 Aug 24 10:21:02.025558 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 268/536] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:01 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:02.102168 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-b01e1663-effb-454d-a893-a0aa44ee136b req-518c6bef-ad69-4c31-99d2-35751cb42c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa35bff-3f3e-4a84-af4f-cdb62e5a4481", "tag": "50a4db0b-fe10-4ecc-9fab-c39a1162c94a"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:02.122380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-b01e1663-effb-454d-a893-a0aa44ee136b req-518c6bef-ad69-4c31-99d2-35751cb42c3d service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:02.122930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-b01e1663-effb-454d-a893-a0aa44ee136b req-518c6bef-ad69-4c31-99d2-35751cb42c3d service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:02.123517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-b01e1663-effb-454d-a893-a0aa44ee136b req-518c6bef-ad69-4c31-99d2-35751cb42c3d service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:02.140255 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-b01e1663-effb-454d-a893-a0aa44ee136b req-518c6bef-ad69-4c31-99d2-35751cb42c3d service nova] Creating event network-changed:50a4db0b-fe10-4ecc-9fab-c39a1162c94a for instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 on hv-cinder-85427 Aug 24 10:21:02.146747 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-b01e1663-effb-454d-a893-a0aa44ee136b req-518c6bef-ad69-4c31-99d2-35751cb42c3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049206 Aug 24 10:21:02.147646 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 269/537] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:02.184734 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c0b70abe-2f67-495b-984d-518e1aa2e685 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:02.186019 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c0b70abe-2f67-495b-984d-518e1aa2e685 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:02.196528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c0b70abe-2f67-495b-984d-518e1aa2e685 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:02.199372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c0b70abe-2f67-495b-984d-518e1aa2e685 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:02.201595 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c0b70abe-2f67-495b-984d-518e1aa2e685 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:02.204325 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c0b70abe-2f67-495b-984d-518e1aa2e685 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:02.204816 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c0b70abe-2f67-495b-984d-518e1aa2e685 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:02.205288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c0b70abe-2f67-495b-984d-518e1aa2e685 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:02.228588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:02.351961 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c0b70abe-2f67-495b-984d-518e1aa2e685 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:02.360253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c0b70abe-2f67-495b-984d-518e1aa2e685 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1362 microversion: 2.1 time: 0.180400 Aug 24 10:21:02.360954 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 269/538] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:02 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:03.050912 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:03.051657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:03.058049 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:03.058530 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:03.058961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:03.059680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:03.060134 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:03.060557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:03.260789 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:03.275424 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:03.277292 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:03.278612 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0aefb9fa-96fc-4a0f-b7be-abc36fcd0dd6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1796 microversion: 2.20 time: 0.232456 Aug 24 10:21:03.279324 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 270/539] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:03 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1796 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:03.382741 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-dd1ae048-8862-40c4-9597-f191c7efdd98 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:03.383347 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-dd1ae048-8862-40c4-9597-f191c7efdd98 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:03.390184 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dd1ae048-8862-40c4-9597-f191c7efdd98 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:03.390657 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dd1ae048-8862-40c4-9597-f191c7efdd98 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:03.391090 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dd1ae048-8862-40c4-9597-f191c7efdd98 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:03.392107 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dd1ae048-8862-40c4-9597-f191c7efdd98 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:03.392429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dd1ae048-8862-40c4-9597-f191c7efdd98 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:03.392850 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dd1ae048-8862-40c4-9597-f191c7efdd98 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:03.532461 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-dd1ae048-8862-40c4-9597-f191c7efdd98 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:03.540425 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-dd1ae048-8862-40c4-9597-f191c7efdd98 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1362 microversion: 2.1 time: 0.162798 Aug 24 10:21:03.541016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 270/540] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:03 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:04.162181 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-7a48bf74-8136-423f-b2f0-154b2b07d8c0 req-1e3ca706-1e62-4901-8a99-d8d107faa067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa35bff-3f3e-4a84-af4f-cdb62e5a4481", "tag": "50a4db0b-fe10-4ecc-9fab-c39a1162c94a"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:04.172189 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-7a48bf74-8136-423f-b2f0-154b2b07d8c0 req-1e3ca706-1e62-4901-8a99-d8d107faa067 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:04.172726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-7a48bf74-8136-423f-b2f0-154b2b07d8c0 req-1e3ca706-1e62-4901-8a99-d8d107faa067 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:04.173178 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-7a48bf74-8136-423f-b2f0-154b2b07d8c0 req-1e3ca706-1e62-4901-8a99-d8d107faa067 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:04.184643 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-7a48bf74-8136-423f-b2f0-154b2b07d8c0 req-1e3ca706-1e62-4901-8a99-d8d107faa067 service nova] Creating event network-changed:50a4db0b-fe10-4ecc-9fab-c39a1162c94a for instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 on hv-cinder-85427 Aug 24 10:21:04.189458 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-7a48bf74-8136-423f-b2f0-154b2b07d8c0 req-1e3ca706-1e62-4901-8a99-d8d107faa067 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031798 Aug 24 10:21:04.190041 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 271/541] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:04.564298 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3e383e71-1b3f-474f-9873-c0282709e322 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:04.565244 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3e383e71-1b3f-474f-9873-c0282709e322 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:04.572351 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e383e71-1b3f-474f-9873-c0282709e322 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:04.573388 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e383e71-1b3f-474f-9873-c0282709e322 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:04.573592 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e383e71-1b3f-474f-9873-c0282709e322 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:04.574324 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e383e71-1b3f-474f-9873-c0282709e322 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:04.574928 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e383e71-1b3f-474f-9873-c0282709e322 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:04.575368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e383e71-1b3f-474f-9873-c0282709e322 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:04.710166 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3e383e71-1b3f-474f-9873-c0282709e322 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:04.717970 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3e383e71-1b3f-474f-9873-c0282709e322 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1552 microversion: 2.1 time: 0.158032 Aug 24 10:21:04.718537 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 271/542] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:04 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:04.739127 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0355e123-a082-4a99-8c90-60a361165e65 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:04.740305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0355e123-a082-4a99-8c90-60a361165e65 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:04.746450 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0355e123-a082-4a99-8c90-60a361165e65 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:04.746932 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0355e123-a082-4a99-8c90-60a361165e65 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:04.747366 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0355e123-a082-4a99-8c90-60a361165e65 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:04.748055 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0355e123-a082-4a99-8c90-60a361165e65 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:04.748505 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0355e123-a082-4a99-8c90-60a361165e65 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:04.748956 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0355e123-a082-4a99-8c90-60a361165e65 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:04.861302 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0355e123-a082-4a99-8c90-60a361165e65 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126566 Aug 24 10:21:04.861913 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 272/543] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Aug 24 10:21:04 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:06.203219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-bb3831ec-6b92-4f67-80e9-da2db4351bba req-f8205aa7-4501-4d31-8594-705a307cb902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1", "tag": "a0b112d7-221f-4e33-a257-82953d4549d7"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:06.208993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=4 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:06.214289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-bb3831ec-6b92-4f67-80e9-da2db4351bba req-f8205aa7-4501-4d31-8594-705a307cb902 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:06.214785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-bb3831ec-6b92-4f67-80e9-da2db4351bba req-f8205aa7-4501-4d31-8594-705a307cb902 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:06.215214 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-bb3831ec-6b92-4f67-80e9-da2db4351bba req-f8205aa7-4501-4d31-8594-705a307cb902 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:06.232653 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-bb3831ec-6b92-4f67-80e9-da2db4351bba req-f8205aa7-4501-4d31-8594-705a307cb902 service nova] Creating event network-changed:a0b112d7-221f-4e33-a257-82953d4549d7 for instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 on hv-cinder-85427 Aug 24 10:21:06.232653 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-bb3831ec-6b92-4f67-80e9-da2db4351bba req-f8205aa7-4501-4d31-8594-705a307cb902 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032435 Aug 24 10:21:06.232653 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 272/544] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:16.829790 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=34 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:16.830150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=27 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:16.834000 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1144026571", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1965718378", "security_groups": [{"name": "tempest-secgroup-smoke-1757833568"}], "networks": [{"uuid": "03da7f85-f96d-47cd-aedd-e1a93c937337"}], "block_device_mapping_v2": [{"uuid": "ab356e0c-968b-4d0c-8a0d-3ffb9bc65544", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:16.948729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] validate_networks() for [('03da7f85-f96d-47cd-aedd-e1a93c937337', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:21:17.546267 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:21:17.546682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:21:17.547148 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:21:17.547605 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:21:17.547952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:21:17.556537 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:17.557470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:17.557903 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:17.558615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:17.559058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:17.559469 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:17.577574 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Getting quotas for project f2c601f7e6b64f83919d960b601e9331. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:21:17.581461 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Getting quotas for user c28281bb90464004a751699a49c61ebf and project f2c601f7e6b64f83919d960b601e9331. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:21:17.638345 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:21:17.640463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab356e0c-968b-4d0c-8a0d-3ffb9bc65544',volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:21:18.266812 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c5f6efc2-a285-4c1f-ae90-92464731a134 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.439006 Aug 24 10:21:18.270652 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 273/545] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:21:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:21:18.276886 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:18.278059 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=16 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:18.282974 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-62ab03d0-ef7e-4c44-8a03-f7be476cbe8f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:18.283945 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-62ab03d0-ef7e-4c44-8a03-f7be476cbe8f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:18.346617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-62ab03d0-ef7e-4c44-8a03-f7be476cbe8f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:18.356998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-62ab03d0-ef7e-4c44-8a03-f7be476cbe8f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1089 microversion: 2.1 time: 0.081802 Aug 24 10:21:18.357782 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 273/546] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:18 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1089 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:19.379268 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-135757c3-93bd-44d7-a425-c22fe1c35bc8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:19.379926 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-135757c3-93bd-44d7-a425-c22fe1c35bc8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:19.387490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-135757c3-93bd-44d7-a425-c22fe1c35bc8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:19.387982 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-135757c3-93bd-44d7-a425-c22fe1c35bc8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:19.388423 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-135757c3-93bd-44d7-a425-c22fe1c35bc8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:19.389179 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-135757c3-93bd-44d7-a425-c22fe1c35bc8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:19.389632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-135757c3-93bd-44d7-a425-c22fe1c35bc8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:19.390070 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-135757c3-93bd-44d7-a425-c22fe1c35bc8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:19.454581 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-135757c3-93bd-44d7-a425-c22fe1c35bc8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:19.462415 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-135757c3-93bd-44d7-a425-c22fe1c35bc8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1139 microversion: 2.1 time: 0.087536 Aug 24 10:21:19.462983 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 274/547] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:19 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:20.482938 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d1829128-825e-4b4e-bcde-b0f447741eb8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:20.483596 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d1829128-825e-4b4e-bcde-b0f447741eb8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:20.491396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1829128-825e-4b4e-bcde-b0f447741eb8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:20.491884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1829128-825e-4b4e-bcde-b0f447741eb8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:20.492334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1829128-825e-4b4e-bcde-b0f447741eb8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:20.493059 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1829128-825e-4b4e-bcde-b0f447741eb8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:20.493518 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1829128-825e-4b4e-bcde-b0f447741eb8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:20.493941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1829128-825e-4b4e-bcde-b0f447741eb8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:20.560103 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d1829128-825e-4b4e-bcde-b0f447741eb8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:20.567808 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d1829128-825e-4b4e-bcde-b0f447741eb8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1187 microversion: 2.1 time: 0.088771 Aug 24 10:21:20.568379 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 274/548] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:20 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:21.593537 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d7dbf65a-970b-494b-969c-9cd437dd4183 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:21.598060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d7dbf65a-970b-494b-969c-9cd437dd4183 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:21.606788 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d7dbf65a-970b-494b-969c-9cd437dd4183 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:21.609401 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d7dbf65a-970b-494b-969c-9cd437dd4183 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:21.609401 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d7dbf65a-970b-494b-969c-9cd437dd4183 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:21.609401 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d7dbf65a-970b-494b-969c-9cd437dd4183 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:21.609401 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d7dbf65a-970b-494b-969c-9cd437dd4183 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:21.609755 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d7dbf65a-970b-494b-969c-9cd437dd4183 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:21.796622 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d7dbf65a-970b-494b-969c-9cd437dd4183 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:21.804683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d7dbf65a-970b-494b-969c-9cd437dd4183 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1273 microversion: 2.1 time: 0.219441 Aug 24 10:21:21.805462 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 275/549] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:21 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:22.516156 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-655a4c3d-0ca6-46fd-9242-936777f9e8e1 req-bda892ba-3ed3-4015-8400-5e04fcdea3bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d352ff4a-5771-4d5d-a56c-9708b7e68182", "tag": "ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:22.525720 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-655a4c3d-0ca6-46fd-9242-936777f9e8e1 req-bda892ba-3ed3-4015-8400-5e04fcdea3bd service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:22.526889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-655a4c3d-0ca6-46fd-9242-936777f9e8e1 req-bda892ba-3ed3-4015-8400-5e04fcdea3bd service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:22.527672 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-655a4c3d-0ca6-46fd-9242-936777f9e8e1 req-bda892ba-3ed3-4015-8400-5e04fcdea3bd service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:22.539486 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-655a4c3d-0ca6-46fd-9242-936777f9e8e1 req-bda892ba-3ed3-4015-8400-5e04fcdea3bd service nova] Creating event network-changed:ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77 for instance d352ff4a-5771-4d5d-a56c-9708b7e68182 on hv-cinder-85427 Aug 24 10:21:22.544705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-655a4c3d-0ca6-46fd-9242-936777f9e8e1 req-bda892ba-3ed3-4015-8400-5e04fcdea3bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033396 Aug 24 10:21:22.545505 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 275/550] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:22.830261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5be6d129-1ac6-4405-9fd0-be72d0597439 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:22.830919 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5be6d129-1ac6-4405-9fd0-be72d0597439 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:22.837680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5be6d129-1ac6-4405-9fd0-be72d0597439 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:22.838448 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5be6d129-1ac6-4405-9fd0-be72d0597439 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:22.838655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5be6d129-1ac6-4405-9fd0-be72d0597439 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:22.839357 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5be6d129-1ac6-4405-9fd0-be72d0597439 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:22.839801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5be6d129-1ac6-4405-9fd0-be72d0597439 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:22.840395 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5be6d129-1ac6-4405-9fd0-be72d0597439 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:22.996879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5be6d129-1ac6-4405-9fd0-be72d0597439 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:23.005924 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5be6d129-1ac6-4405-9fd0-be72d0597439 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.179622 Aug 24 10:21:23.006683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 276/551] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:22 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:24.028229 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3512b72e-42fb-4736-8210-6b85d65221fe tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:24.028947 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3512b72e-42fb-4736-8210-6b85d65221fe tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:24.035709 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3512b72e-42fb-4736-8210-6b85d65221fe tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:24.036191 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3512b72e-42fb-4736-8210-6b85d65221fe tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:24.036623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3512b72e-42fb-4736-8210-6b85d65221fe tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:24.037350 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3512b72e-42fb-4736-8210-6b85d65221fe tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:24.037871 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3512b72e-42fb-4736-8210-6b85d65221fe tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:24.038299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3512b72e-42fb-4736-8210-6b85d65221fe tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:24.171796 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3512b72e-42fb-4736-8210-6b85d65221fe tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:24.181015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3512b72e-42fb-4736-8210-6b85d65221fe tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.157109 Aug 24 10:21:24.181585 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 276/552] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:24 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:25.202284 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-dac95d57-338f-4c07-a35a-4d7e5d92af04 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:25.203073 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-dac95d57-338f-4c07-a35a-4d7e5d92af04 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:25.211054 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dac95d57-338f-4c07-a35a-4d7e5d92af04 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:25.211533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dac95d57-338f-4c07-a35a-4d7e5d92af04 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:25.211965 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dac95d57-338f-4c07-a35a-4d7e5d92af04 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:25.213102 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dac95d57-338f-4c07-a35a-4d7e5d92af04 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:25.213945 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dac95d57-338f-4c07-a35a-4d7e5d92af04 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:25.214673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dac95d57-338f-4c07-a35a-4d7e5d92af04 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:25.348214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-dac95d57-338f-4c07-a35a-4d7e5d92af04 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:25.356460 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-dac95d57-338f-4c07-a35a-4d7e5d92af04 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.159298 Aug 24 10:21:25.357065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 277/553] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:25 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:26.377700 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8ddc8f68-3e45-407a-ae90-b5fec01871ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:26.378296 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8ddc8f68-3e45-407a-ae90-b5fec01871ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:26.385495 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ddc8f68-3e45-407a-ae90-b5fec01871ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:26.385990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ddc8f68-3e45-407a-ae90-b5fec01871ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:26.386430 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ddc8f68-3e45-407a-ae90-b5fec01871ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:26.387221 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ddc8f68-3e45-407a-ae90-b5fec01871ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:26.387681 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ddc8f68-3e45-407a-ae90-b5fec01871ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:26.388110 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8ddc8f68-3e45-407a-ae90-b5fec01871ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:26.517560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8ddc8f68-3e45-407a-ae90-b5fec01871ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:26.525288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8ddc8f68-3e45-407a-ae90-b5fec01871ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.151384 Aug 24 10:21:26.525866 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 277/554] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:26 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:27.547125 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-25619501-d21d-4c77-8d5f-4be7bef07313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:27.547793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-25619501-d21d-4c77-8d5f-4be7bef07313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:27.554095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-25619501-d21d-4c77-8d5f-4be7bef07313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:27.554567 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-25619501-d21d-4c77-8d5f-4be7bef07313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:27.554997 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-25619501-d21d-4c77-8d5f-4be7bef07313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:27.555680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-25619501-d21d-4c77-8d5f-4be7bef07313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:27.556134 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-25619501-d21d-4c77-8d5f-4be7bef07313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:27.556552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-25619501-d21d-4c77-8d5f-4be7bef07313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:27.571109 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:27.587488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=6 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:27.689877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-25619501-d21d-4c77-8d5f-4be7bef07313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:27.697552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-25619501-d21d-4c77-8d5f-4be7bef07313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.154280 Aug 24 10:21:27.698151 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 278/555] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:27 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:28.718219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a0577dfd-193c-4657-a349-7f7735133690 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:28.718837 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a0577dfd-193c-4657-a349-7f7735133690 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:28.721337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:28.726078 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0577dfd-193c-4657-a349-7f7735133690 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:28.726556 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0577dfd-193c-4657-a349-7f7735133690 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:28.727034 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0577dfd-193c-4657-a349-7f7735133690 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:28.727721 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0577dfd-193c-4657-a349-7f7735133690 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:28.728172 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0577dfd-193c-4657-a349-7f7735133690 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:28.728595 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a0577dfd-193c-4657-a349-7f7735133690 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:28.863472 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a0577dfd-193c-4657-a349-7f7735133690 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:28.872129 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a0577dfd-193c-4657-a349-7f7735133690 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.157783 Aug 24 10:21:28.872697 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 278/556] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:28 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:29.893626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1a72874c-b5dc-442a-a683-89e2de3e1a5b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:29.899139 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1a72874c-b5dc-442a-a683-89e2de3e1a5b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:29.900963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a72874c-b5dc-442a-a683-89e2de3e1a5b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:29.901492 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a72874c-b5dc-442a-a683-89e2de3e1a5b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:29.901935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a72874c-b5dc-442a-a683-89e2de3e1a5b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:29.902655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a72874c-b5dc-442a-a683-89e2de3e1a5b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:29.903107 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a72874c-b5dc-442a-a683-89e2de3e1a5b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:29.903528 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1a72874c-b5dc-442a-a683-89e2de3e1a5b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:30.032995 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1a72874c-b5dc-442a-a683-89e2de3e1a5b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:30.040590 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1a72874c-b5dc-442a-a683-89e2de3e1a5b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.151082 Aug 24 10:21:30.041191 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 279/557] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:29 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:31.061167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1516a8d4-b4c2-4048-8cea-88450b28eb44 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:31.061805 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-1516a8d4-b4c2-4048-8cea-88450b28eb44 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:31.068125 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1516a8d4-b4c2-4048-8cea-88450b28eb44 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:31.068601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1516a8d4-b4c2-4048-8cea-88450b28eb44 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:31.069059 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1516a8d4-b4c2-4048-8cea-88450b28eb44 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:31.069741 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1516a8d4-b4c2-4048-8cea-88450b28eb44 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:31.070186 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1516a8d4-b4c2-4048-8cea-88450b28eb44 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:31.070602 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1516a8d4-b4c2-4048-8cea-88450b28eb44 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:31.202846 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1516a8d4-b4c2-4048-8cea-88450b28eb44 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:31.210469 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1516a8d4-b4c2-4048-8cea-88450b28eb44 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.153295 Aug 24 10:21:31.211037 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 279/558] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:31 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:32.232348 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cd29b833-caf6-4cdc-863a-aea48ac10a27 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:32.233188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cd29b833-caf6-4cdc-863a-aea48ac10a27 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:32.240739 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd29b833-caf6-4cdc-863a-aea48ac10a27 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.241394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd29b833-caf6-4cdc-863a-aea48ac10a27 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.241704 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd29b833-caf6-4cdc-863a-aea48ac10a27 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.242617 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd29b833-caf6-4cdc-863a-aea48ac10a27 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.243075 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd29b833-caf6-4cdc-863a-aea48ac10a27 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.243506 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cd29b833-caf6-4cdc-863a-aea48ac10a27 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.397715 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cd29b833-caf6-4cdc-863a-aea48ac10a27 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:32.411372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cd29b833-caf6-4cdc-863a-aea48ac10a27 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.183738 Aug 24 10:21:32.412104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 280/559] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:32 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:32.468780 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8a127b27-ccc0-4280-ab38-4ec92c9df6b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:32.471022 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8a127b27-ccc0-4280-ab38-4ec92c9df6b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:32.477622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8a127b27-ccc0-4280-ab38-4ec92c9df6b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.478148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8a127b27-ccc0-4280-ab38-4ec92c9df6b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.478586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8a127b27-ccc0-4280-ab38-4ec92c9df6b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.479395 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8a127b27-ccc0-4280-ab38-4ec92c9df6b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.479856 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8a127b27-ccc0-4280-ab38-4ec92c9df6b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.480472 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8a127b27-ccc0-4280-ab38-4ec92c9df6b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.510389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8a127b27-ccc0-4280-ab38-4ec92c9df6b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046546 Aug 24 10:21:32.511468 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 280/560] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:21:32 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:21:32.573939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-eb5bfaff-4711-44dd-8c21-949c005811f3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:32.574434 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-eb5bfaff-4711-44dd-8c21-949c005811f3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:32.580436 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb5bfaff-4711-44dd-8c21-949c005811f3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.580947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb5bfaff-4711-44dd-8c21-949c005811f3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.581410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb5bfaff-4711-44dd-8c21-949c005811f3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.582094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb5bfaff-4711-44dd-8c21-949c005811f3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.582544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb5bfaff-4711-44dd-8c21-949c005811f3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.582966 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eb5bfaff-4711-44dd-8c21-949c005811f3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.608868 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-eb5bfaff-4711-44dd-8c21-949c005811f3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Going to try to terminate instance {{(pid=121270) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:21:32.914650 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-eb5bfaff-4711-44dd-8c21-949c005811f3 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "DELETE /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 204 len: 0 microversion: 2.1 time: 0.344841 Aug 24 10:21:32.915249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 281/561] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:21:32 2022] DELETE /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:32.924307 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f243fce3-3988-4b6e-bf32-1075d2ea9b38 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:32.924957 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f243fce3-3988-4b6e-bf32-1075d2ea9b38 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:32.931086 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f243fce3-3988-4b6e-bf32-1075d2ea9b38 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.931788 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f243fce3-3988-4b6e-bf32-1075d2ea9b38 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.932033 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f243fce3-3988-4b6e-bf32-1075d2ea9b38 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:32.932849 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f243fce3-3988-4b6e-bf32-1075d2ea9b38 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:32.933573 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f243fce3-3988-4b6e-bf32-1075d2ea9b38 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:32.934012 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f243fce3-3988-4b6e-bf32-1075d2ea9b38 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:33.067220 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f243fce3-3988-4b6e-bf32-1075d2ea9b38 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:33.075595 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f243fce3-3988-4b6e-bf32-1075d2ea9b38 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1673 microversion: 2.1 time: 0.155097 Aug 24 10:21:33.078832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 281/562] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:32 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:33.434041 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ba9f3816-add2-43f9-a261-d628ab5c27c1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:33.434740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ba9f3816-add2-43f9-a261-d628ab5c27c1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:33.441247 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba9f3816-add2-43f9-a261-d628ab5c27c1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:33.441735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba9f3816-add2-43f9-a261-d628ab5c27c1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:33.442175 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba9f3816-add2-43f9-a261-d628ab5c27c1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:33.442873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba9f3816-add2-43f9-a261-d628ab5c27c1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:33.443326 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba9f3816-add2-43f9-a261-d628ab5c27c1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:33.443749 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ba9f3816-add2-43f9-a261-d628ab5c27c1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:33.580939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ba9f3816-add2-43f9-a261-d628ab5c27c1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:33.588733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ba9f3816-add2-43f9-a261-d628ab5c27c1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.159442 Aug 24 10:21:33.589328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 282/563] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:33 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:33.629617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-c35c35d8-25af-4d60-a584-d8ca8dd2aab0 req-d3e48232-1c70-4d0a-941e-fdcac9663d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d352ff4a-5771-4d5d-a56c-9708b7e68182", "name": "network-vif-plugged", "status": "completed", "tag": "ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:33.639922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-c35c35d8-25af-4d60-a584-d8ca8dd2aab0 req-d3e48232-1c70-4d0a-941e-fdcac9663d8d service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:33.640397 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-c35c35d8-25af-4d60-a584-d8ca8dd2aab0 req-d3e48232-1c70-4d0a-941e-fdcac9663d8d service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:33.641469 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-c35c35d8-25af-4d60-a584-d8ca8dd2aab0 req-d3e48232-1c70-4d0a-941e-fdcac9663d8d service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:33.651849 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-c35c35d8-25af-4d60-a584-d8ca8dd2aab0 req-d3e48232-1c70-4d0a-941e-fdcac9663d8d service nova] Creating event network-vif-plugged:ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77 for instance d352ff4a-5771-4d5d-a56c-9708b7e68182 on hv-cinder-85427 Aug 24 10:21:33.656739 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-c35c35d8-25af-4d60-a584-d8ca8dd2aab0 req-d3e48232-1c70-4d0a-941e-fdcac9663d8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030815 Aug 24 10:21:33.657360 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 282/564] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:34.097360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-797e1810-5983-4ef1-a46f-50d3dedbb45b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:34.097888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-797e1810-5983-4ef1-a46f-50d3dedbb45b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:34.103733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-797e1810-5983-4ef1-a46f-50d3dedbb45b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:34.104212 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-797e1810-5983-4ef1-a46f-50d3dedbb45b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:34.105165 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-797e1810-5983-4ef1-a46f-50d3dedbb45b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:34.105844 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-797e1810-5983-4ef1-a46f-50d3dedbb45b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:34.106290 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-797e1810-5983-4ef1-a46f-50d3dedbb45b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:34.106701 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-797e1810-5983-4ef1-a46f-50d3dedbb45b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:34.235366 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-797e1810-5983-4ef1-a46f-50d3dedbb45b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:34.243198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-797e1810-5983-4ef1-a46f-50d3dedbb45b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1673 microversion: 2.1 time: 0.149787 Aug 24 10:21:34.243762 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 283/565] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:34 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:34.610644 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-587d00b3-3d05-4151-a867-eb278656c280 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:34.611348 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-587d00b3-3d05-4151-a867-eb278656c280 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:34.617886 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-587d00b3-3d05-4151-a867-eb278656c280 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:34.618369 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-587d00b3-3d05-4151-a867-eb278656c280 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:34.618806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-587d00b3-3d05-4151-a867-eb278656c280 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:34.619496 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-587d00b3-3d05-4151-a867-eb278656c280 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:34.620642 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-587d00b3-3d05-4151-a867-eb278656c280 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:34.621111 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-587d00b3-3d05-4151-a867-eb278656c280 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:34.753654 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-587d00b3-3d05-4151-a867-eb278656c280 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:34.761398 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-587d00b3-3d05-4151-a867-eb278656c280 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.154987 Aug 24 10:21:34.761976 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 283/566] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:34 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:35.263635 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b0c0e3c6-408f-4c95-a1e2-2111b4f8d592 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:35.264251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b0c0e3c6-408f-4c95-a1e2-2111b4f8d592 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:35.270720 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b0c0e3c6-408f-4c95-a1e2-2111b4f8d592 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:35.271201 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b0c0e3c6-408f-4c95-a1e2-2111b4f8d592 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:35.271638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b0c0e3c6-408f-4c95-a1e2-2111b4f8d592 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:35.272330 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b0c0e3c6-408f-4c95-a1e2-2111b4f8d592 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:35.272781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b0c0e3c6-408f-4c95-a1e2-2111b4f8d592 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:35.273226 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b0c0e3c6-408f-4c95-a1e2-2111b4f8d592 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:35.462886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b0c0e3c6-408f-4c95-a1e2-2111b4f8d592 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:35.471067 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b0c0e3c6-408f-4c95-a1e2-2111b4f8d592 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1673 microversion: 2.1 time: 0.211299 Aug 24 10:21:35.471640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 284/567] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:35 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1673 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:35.783606 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d96eb9fa-2690-4d44-8c66-a3aa7586081c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:35.784123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d96eb9fa-2690-4d44-8c66-a3aa7586081c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:35.790615 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d96eb9fa-2690-4d44-8c66-a3aa7586081c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:35.791037 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d96eb9fa-2690-4d44-8c66-a3aa7586081c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:35.791465 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d96eb9fa-2690-4d44-8c66-a3aa7586081c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:35.792887 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d96eb9fa-2690-4d44-8c66-a3aa7586081c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:35.793343 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d96eb9fa-2690-4d44-8c66-a3aa7586081c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:35.793764 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d96eb9fa-2690-4d44-8c66-a3aa7586081c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:35.931134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d96eb9fa-2690-4d44-8c66-a3aa7586081c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:35.939865 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d96eb9fa-2690-4d44-8c66-a3aa7586081c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.160647 Aug 24 10:21:35.940518 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 284/568] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:35 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:36.425212 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-a3e0c213-a4a8-40f3-a26a-d78293615672 req-468aa1bf-85e4-4837-a9ad-8cdc5200d3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29717cf7-618e-46fd-96cd-12597975a07c", "name": "network-vif-deleted", "tag": "42bd17a1-04d1-4e27-90fb-1df530d8ba0b"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:36.435286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-a3e0c213-a4a8-40f3-a26a-d78293615672 req-468aa1bf-85e4-4837-a9ad-8cdc5200d3e3 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:36.435969 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-a3e0c213-a4a8-40f3-a26a-d78293615672 req-468aa1bf-85e4-4837-a9ad-8cdc5200d3e3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:36.436176 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-a3e0c213-a4a8-40f3-a26a-d78293615672 req-468aa1bf-85e4-4837-a9ad-8cdc5200d3e3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:36.447306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-a3e0c213-a4a8-40f3-a26a-d78293615672 req-468aa1bf-85e4-4837-a9ad-8cdc5200d3e3 service nova] Creating event network-vif-deleted:42bd17a1-04d1-4e27-90fb-1df530d8ba0b for instance 29717cf7-618e-46fd-96cd-12597975a07c on hv-cinder-85427 Aug 24 10:21:36.452623 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-a3e0c213-a4a8-40f3-a26a-d78293615672 req-468aa1bf-85e4-4837-a9ad-8cdc5200d3e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031045 Aug 24 10:21:36.453370 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 285/569] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:21:36.499129 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-5c010c10-5306-46af-8060-9f91d8b17043 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:36.499129 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-5c010c10-5306-46af-8060-9f91d8b17043 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:36.499973 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c010c10-5306-46af-8060-9f91d8b17043 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:36.500651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c010c10-5306-46af-8060-9f91d8b17043 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:36.501285 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c010c10-5306-46af-8060-9f91d8b17043 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:36.502178 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c010c10-5306-46af-8060-9f91d8b17043 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:36.502636 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c010c10-5306-46af-8060-9f91d8b17043 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:36.503061 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5c010c10-5306-46af-8060-9f91d8b17043 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:36.574061 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-5c010c10-5306-46af-8060-9f91d8b17043 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:36.582460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-5c010c10-5306-46af-8060-9f91d8b17043 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1606 microversion: 2.1 time: 0.093775 Aug 24 10:21:36.583987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 285/570] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:36 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:36.962640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6e00c56f-3021-4361-ac99-e443ce22adfb tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:36.963361 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6e00c56f-3021-4361-ac99-e443ce22adfb tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:36.970149 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e00c56f-3021-4361-ac99-e443ce22adfb tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:36.970632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e00c56f-3021-4361-ac99-e443ce22adfb tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:36.971075 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e00c56f-3021-4361-ac99-e443ce22adfb tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:36.971772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e00c56f-3021-4361-ac99-e443ce22adfb tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:36.972229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e00c56f-3021-4361-ac99-e443ce22adfb tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:36.972651 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e00c56f-3021-4361-ac99-e443ce22adfb tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:37.105773 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6e00c56f-3021-4361-ac99-e443ce22adfb tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:37.114055 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6e00c56f-3021-4361-ac99-e443ce22adfb tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1261 microversion: 2.1 time: 0.155837 Aug 24 10:21:37.114634 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 286/571] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:36 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:37.605778 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:37.606377 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:37.613133 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:37.613617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:37.614048 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:37.614728 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:37.615266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:37.615578 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:37.646920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:37.647397 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:37.647831 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:37.648272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lazy-loading 'fault' on Instance uuid 29717cf7-618e-46fd-96cd-12597975a07c {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:21:37.689273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:37.697055 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2ff3c6a5-07eb-4e1b-9b2e-d02160d0798f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 200 len: 1328 microversion: 2.1 time: 0.095860 Aug 24 10:21:37.697622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 286/572] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:37 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:38.134962 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7799e678-1a43-4f94-9bb2-1c15031ce6b7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:38.135615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7799e678-1a43-4f94-9bb2-1c15031ce6b7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:38.142551 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7799e678-1a43-4f94-9bb2-1c15031ce6b7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:38.143038 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7799e678-1a43-4f94-9bb2-1c15031ce6b7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:38.143531 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7799e678-1a43-4f94-9bb2-1c15031ce6b7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.144233 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7799e678-1a43-4f94-9bb2-1c15031ce6b7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:38.144688 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7799e678-1a43-4f94-9bb2-1c15031ce6b7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:38.145146 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7799e678-1a43-4f94-9bb2-1c15031ce6b7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.280352 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7799e678-1a43-4f94-9bb2-1c15031ce6b7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:38.288762 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7799e678-1a43-4f94-9bb2-1c15031ce6b7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1444 microversion: 2.1 time: 0.157615 Aug 24 10:21:38.289438 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 287/573] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:38 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:38.310075 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-558f4d0f-55fe-4215-bba6-37939cfec4ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:38.310703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-558f4d0f-55fe-4215-bba6-37939cfec4ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:38.316792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-558f4d0f-55fe-4215-bba6-37939cfec4ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:38.317370 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-558f4d0f-55fe-4215-bba6-37939cfec4ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:38.317816 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-558f4d0f-55fe-4215-bba6-37939cfec4ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.318519 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-558f4d0f-55fe-4215-bba6-37939cfec4ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:38.318982 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-558f4d0f-55fe-4215-bba6-37939cfec4ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:38.319412 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-558f4d0f-55fe-4215-bba6-37939cfec4ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.453220 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-558f4d0f-55fe-4215-bba6-37939cfec4ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:38.458404 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-558f4d0f-55fe-4215-bba6-37939cfec4ab tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1444 microversion: 2.1 time: 0.152472 Aug 24 10:21:38.459027 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 287/574] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:38 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:38.719350 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:38.720020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:38.726198 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:38.726682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:38.727120 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.727842 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:38.728296 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:38.728725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:38.742843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] HTTP exception thrown: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Request method failure captured: Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c HTTP/1.1 Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqjHR2oq5wAV2cX5T_IYKFIMWiXuRXYF-wmrhwuPpVxfX4GAQpPkiAZKZbvkBPIYfoldoJxF29v57eZfMrQqc-MSr5mmH9_EbZnicFJA7hwhH_yCsGUKyjP1xxZWms_lX_c0buWRNL5OP1Dk7Frkuiygg8ZMPDJFu9li67c6qGh6Cs Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 297fa582000543acbf078376d7010abb Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:21:38.744588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_297fa582000543acbf078376d7010abb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/297fa582000543acbf078376d7010abb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 297fa582000543acbf078376d7010abb Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 71c5ac35123e425e9753f372f9c6bac0 Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:21:38.746525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '29717cf7-618e-46fd-96cd-12597975a07c'} Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:21:38.747309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:21:38.748510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:21:38.750402 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Returning 404 to user: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:21:38.750402 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-096ffd3b-c26f-4388-a0f1-41e479aa8967 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 404 len: 111 microversion: 2.1 time: 0.031714 Aug 24 10:21:38.750402 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 288/575] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:38 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:21:38.756102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4420b614-3239-4040-bb52-ac5e84ebc081 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '.version_select at 0x7f0af407aa60>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:38.851477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4420b614-3239-4040-bb52-ac5e84ebc081 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760383912" status: 202 len: 0 microversion: 2.1 time: 0.099011 Aug 24 10:21:38.852153 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 288/576] 10.222.0.30 () {58 vars in 1221 bytes} [Wed Aug 24 10:21:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760383912 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:40.214475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f95cdad9-0440-44db-a831-d598caf095ae tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'create', calling method: .version_select at 0x7f0af4117280>, body: {"keypair": {"name": "tempest-keypair-362125495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgos3tWOZ9RffXjGgckD6PeflvirAiPicSHnOrLA1BHxzH+lD660uBdIgHgePnkfH12lmz0iALgssnqgftWltYmCQMQ+xuXzlBTBwW9Q30epKo2cmfCnFywtQz6ZhXljA=="}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:40.230855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-f95cdad9-0440-44db-a831-d598caf095ae tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Getting quotas for project 297fa582000543acbf078376d7010abb. Resources: {'key_pairs'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:21:40.234714 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-f95cdad9-0440-44db-a831-d598caf095ae tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Getting quotas for user 71c5ac35123e425e9753f372f9c6bac0 and project 297fa582000543acbf078376d7010abb. Resources: {'key_pairs'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:21:40.333264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f95cdad9-0440-44db-a831-d598caf095ae tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.122850 Aug 24 10:21:40.333874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 289/577] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Aug 24 10:21:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:41.225061 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-1ec44f3a-ab53-4c79-a342-f40ab302373c req-fbfd2a44-4c12-4278-a83a-cb927b4468ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d352ff4a-5771-4d5d-a56c-9708b7e68182", "tag": "ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:41.236878 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-1ec44f3a-ab53-4c79-a342-f40ab302373c req-fbfd2a44-4c12-4278-a83a-cb927b4468ef service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:41.237356 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-1ec44f3a-ab53-4c79-a342-f40ab302373c req-fbfd2a44-4c12-4278-a83a-cb927b4468ef service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:41.238047 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-1ec44f3a-ab53-4c79-a342-f40ab302373c req-fbfd2a44-4c12-4278-a83a-cb927b4468ef service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:41.249667 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-1ec44f3a-ab53-4c79-a342-f40ab302373c req-fbfd2a44-4c12-4278-a83a-cb927b4468ef service nova] Creating event network-changed:ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77 for instance d352ff4a-5771-4d5d-a56c-9708b7e68182 on hv-cinder-85427 Aug 24 10:21:41.266004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-1ec44f3a-ab53-4c79-a342-f40ab302373c req-fbfd2a44-4c12-4278-a83a-cb927b4468ef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033745 Aug 24 10:21:41.266004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 289/578] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:43.259488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-900781c8-2e4e-403a-a693-b6611e95930d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:43.260050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-900781c8-2e4e-403a-a693-b6611e95930d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:43.269240 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-900781c8-2e4e-403a-a693-b6611e95930d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.270560 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-900781c8-2e4e-403a-a693-b6611e95930d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.271542 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-900781c8-2e4e-403a-a693-b6611e95930d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.272356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-900781c8-2e4e-403a-a693-b6611e95930d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.273164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-900781c8-2e4e-403a-a693-b6611e95930d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.273737 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-900781c8-2e4e-403a-a693-b6611e95930d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.348606 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1586248118", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77ecb39e-74d7-4180-9556-77b172c2fac8"}], "security_groups": [{"name": "tempest-securitygroup--2033821274"}], "key_name": "tempest-keypair-362125495", "user_data": "}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:43.357467 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:43.361421 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-900781c8-2e4e-403a-a693-b6611e95930d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lazy-loading 'services' on Instance uuid ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:21:43.453897 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.network.neutron [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] validate_networks() for [('77ecb39e-74d7-4180-9556-77b172c2fac8', None, None, None, None, None)] {{(pid=121271) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:21:43.611648 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-900781c8-2e4e-403a-a693-b6611e95930d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments/ed7ef0f6-9563-4b36-96fa-aabc63dff1f3" status: 202 len: 0 microversion: 2.1 time: 0.356474 Aug 24 10:21:43.612300 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 290/579] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:21:43 2022] DELETE /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments/ed7ef0f6-9563-4b36-96fa-aabc63dff1f3 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:43.627265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cbeede19-fadc-4833-98b8-f98fadd54d2f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:43.629678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cbeede19-fadc-4833-98b8-f98fadd54d2f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:43.637726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbeede19-fadc-4833-98b8-f98fadd54d2f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.638286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbeede19-fadc-4833-98b8-f98fadd54d2f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.638815 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbeede19-fadc-4833-98b8-f98fadd54d2f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.639593 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbeede19-fadc-4833-98b8-f98fadd54d2f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.640187 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbeede19-fadc-4833-98b8-f98fadd54d2f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.640689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cbeede19-fadc-4833-98b8-f98fadd54d2f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.673726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cbeede19-fadc-4833-98b8-f98fadd54d2f tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050743 Aug 24 10:21:43.674295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 291/580] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:21:43 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:21:43.852925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Flavor limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:21:43.853354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Image limits 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:21:43.853832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Flavor pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:21:43.854328 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Image pref 0:0:0 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:21:43.854745 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.virt.hardware [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:21:43.863871 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.864332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.864770 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.865535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:43.865996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:43.866448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:43.884153 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Getting quotas for project 297fa582000543acbf078376d7010abb. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:21:43.889140 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Getting quotas for user 71c5ac35123e425e9753f372f9c6bac0 and project 297fa582000543acbf078376d7010abb. Resources: {'instances', 'ram', 'cores'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:21:43.900177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Going to run 1 instances... {{(pid=121271) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:21:43.903395 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:21:44.060873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f809cc60-ebfc-4c6f-ac48-79c37efb7e0f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.722387 Aug 24 10:21:44.061261 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 290/581] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:21:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:21:44.074910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d64298e0-df6e-492a-847d-807c25dcca64 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:44.075528 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d64298e0-df6e-492a-847d-807c25dcca64 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:44.130431 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d64298e0-df6e-492a-847d-807c25dcca64 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:44.138251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d64298e0-df6e-492a-847d-807c25dcca64 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1237 microversion: 2.1 time: 0.068083 Aug 24 10:21:44.138826 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 292/582] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:44 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:44.687438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4e6c29ee-dea8-415b-b45e-21e587bbd3ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:44.689651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4e6c29ee-dea8-415b-b45e-21e587bbd3ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:44.696680 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e6c29ee-dea8-415b-b45e-21e587bbd3ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:44.697195 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e6c29ee-dea8-415b-b45e-21e587bbd3ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:44.697730 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e6c29ee-dea8-415b-b45e-21e587bbd3ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:44.698414 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e6c29ee-dea8-415b-b45e-21e587bbd3ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:44.698856 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e6c29ee-dea8-415b-b45e-21e587bbd3ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:44.699275 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e6c29ee-dea8-415b-b45e-21e587bbd3ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:44.729745 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4e6c29ee-dea8-415b-b45e-21e587bbd3ba tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046820 Aug 24 10:21:44.730310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 291/583] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:21:44 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:45.160364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-67df9549-db17-47ad-b252-0a5064be5c93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:45.161426 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-67df9549-db17-47ad-b252-0a5064be5c93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:45.169862 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-67df9549-db17-47ad-b252-0a5064be5c93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.172987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-67df9549-db17-47ad-b252-0a5064be5c93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.172987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-67df9549-db17-47ad-b252-0a5064be5c93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.172987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-67df9549-db17-47ad-b252-0a5064be5c93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.172987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-67df9549-db17-47ad-b252-0a5064be5c93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.173410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-67df9549-db17-47ad-b252-0a5064be5c93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.186297 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0d92c917-7646-4c40-85e9-2f11ee7495b5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:45.186783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0d92c917-7646-4c40-85e9-2f11ee7495b5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:45.193511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d92c917-7646-4c40-85e9-2f11ee7495b5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.194114 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d92c917-7646-4c40-85e9-2f11ee7495b5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.194617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d92c917-7646-4c40-85e9-2f11ee7495b5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.195970 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d92c917-7646-4c40-85e9-2f11ee7495b5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.196175 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d92c917-7646-4c40-85e9-2f11ee7495b5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.196700 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0d92c917-7646-4c40-85e9-2f11ee7495b5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.228032 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0d92c917-7646-4c40-85e9-2f11ee7495b5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments/9bf7b7f8-8206-47de-8686-9cf36adb8426" status: 200 len: 194 microversion: 2.20 time: 0.045796 Aug 24 10:21:45.228729 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 292/584] 10.222.0.30 () {60 vars in 1454 bytes} [Wed Aug 24 10:21:45 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments/9bf7b7f8-8206-47de-8686-9cf36adb8426 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:21:45.236539 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-67df9549-db17-47ad-b252-0a5064be5c93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:45.244776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-67df9549-db17-47ad-b252-0a5064be5c93 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1241 microversion: 2.1 time: 0.089481 Aug 24 10:21:45.245680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 293/585] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:45 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:45.298378 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ca628e0f-d38f-4050-a97d-77abee5fb07a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:45.298378 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ca628e0f-d38f-4050-a97d-77abee5fb07a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:45.304492 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ca628e0f-d38f-4050-a97d-77abee5fb07a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.305009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ca628e0f-d38f-4050-a97d-77abee5fb07a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.305441 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ca628e0f-d38f-4050-a97d-77abee5fb07a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.306132 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ca628e0f-d38f-4050-a97d-77abee5fb07a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.306582 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ca628e0f-d38f-4050-a97d-77abee5fb07a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.307003 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ca628e0f-d38f-4050-a97d-77abee5fb07a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.384002 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=100 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:45.388362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-ca628e0f-d38f-4050-a97d-77abee5fb07a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lazy-loading 'services' on Instance uuid ac36f3b6-c66c-406b-b472-0a2dd018d4c3 {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:21:45.610941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ca628e0f-d38f-4050-a97d-77abee5fb07a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments/9bf7b7f8-8206-47de-8686-9cf36adb8426" status: 202 len: 0 microversion: 2.20 time: 0.316995 Aug 24 10:21:45.611553 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 293/586] 10.222.0.30 () {60 vars in 1457 bytes} [Wed Aug 24 10:21:45 2022] DELETE /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments/9bf7b7f8-8206-47de-8686-9cf36adb8426 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:45.620499 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c78d9805-657b-41c7-a6d5-f0637c2107f2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:45.623926 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c78d9805-657b-41c7-a6d5-f0637c2107f2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:45.630129 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c78d9805-657b-41c7-a6d5-f0637c2107f2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.630617 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c78d9805-657b-41c7-a6d5-f0637c2107f2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.631062 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c78d9805-657b-41c7-a6d5-f0637c2107f2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.631783 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c78d9805-657b-41c7-a6d5-f0637c2107f2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.632243 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c78d9805-657b-41c7-a6d5-f0637c2107f2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.632669 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c78d9805-657b-41c7-a6d5-f0637c2107f2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.662359 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c78d9805-657b-41c7-a6d5-f0637c2107f2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045796 Aug 24 10:21:45.662973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 294/587] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Aug 24 10:21:45 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:21:45.743452 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-35fb7952-2642-4a76-95e2-584f79f666b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:45.745773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-35fb7952-2642-4a76-95e2-584f79f666b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:45.752552 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35fb7952-2642-4a76-95e2-584f79f666b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.753074 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35fb7952-2642-4a76-95e2-584f79f666b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.753531 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35fb7952-2642-4a76-95e2-584f79f666b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.754203 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35fb7952-2642-4a76-95e2-584f79f666b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.754655 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35fb7952-2642-4a76-95e2-584f79f666b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.755080 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35fb7952-2642-4a76-95e2-584f79f666b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.786400 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-35fb7952-2642-4a76-95e2-584f79f666b0 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047637 Aug 24 10:21:45.786952 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 294/588] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:21:45 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:21:45.873621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-817dafe8-1aa1-4b5c-946d-502d58aff21c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:45.874115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-817dafe8-1aa1-4b5c-946d-502d58aff21c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:45.880226 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-817dafe8-1aa1-4b5c-946d-502d58aff21c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.880701 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-817dafe8-1aa1-4b5c-946d-502d58aff21c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.881164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-817dafe8-1aa1-4b5c-946d-502d58aff21c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.882330 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-817dafe8-1aa1-4b5c-946d-502d58aff21c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:45.882788 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-817dafe8-1aa1-4b5c-946d-502d58aff21c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:45.883208 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-817dafe8-1aa1-4b5c-946d-502d58aff21c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:45.909100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-817dafe8-1aa1-4b5c-946d-502d58aff21c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Going to try to terminate instance {{(pid=121270) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:21:46.229193 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-817dafe8-1aa1-4b5c-946d-502d58aff21c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 204 len: 0 microversion: 2.1 time: 0.360758 Aug 24 10:21:46.229866 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 295/589] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:21:45 2022] DELETE /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:46.239087 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b13dc2af-1975-44f5-8a16-5a14415cdc10 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:46.239783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b13dc2af-1975-44f5-8a16-5a14415cdc10 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:46.246178 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b13dc2af-1975-44f5-8a16-5a14415cdc10 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:46.246647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b13dc2af-1975-44f5-8a16-5a14415cdc10 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:46.247255 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b13dc2af-1975-44f5-8a16-5a14415cdc10 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:46.247998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b13dc2af-1975-44f5-8a16-5a14415cdc10 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:46.248454 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b13dc2af-1975-44f5-8a16-5a14415cdc10 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:46.249169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b13dc2af-1975-44f5-8a16-5a14415cdc10 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:46.267261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-dab24398-4892-4efe-9a7b-92f37cec0e1e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:46.273717 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-dab24398-4892-4efe-9a7b-92f37cec0e1e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:46.274523 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dab24398-4892-4efe-9a7b-92f37cec0e1e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:46.275008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dab24398-4892-4efe-9a7b-92f37cec0e1e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:46.275437 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dab24398-4892-4efe-9a7b-92f37cec0e1e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:46.276132 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dab24398-4892-4efe-9a7b-92f37cec0e1e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:46.276577 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dab24398-4892-4efe-9a7b-92f37cec0e1e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:46.277052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dab24398-4892-4efe-9a7b-92f37cec0e1e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:46.355778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-dab24398-4892-4efe-9a7b-92f37cec0e1e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:46.364395 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-dab24398-4892-4efe-9a7b-92f37cec0e1e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1289 microversion: 2.1 time: 0.101586 Aug 24 10:21:46.376882 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 296/590] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:46 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:46.388736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b13dc2af-1975-44f5-8a16-5a14415cdc10 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:46.396840 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b13dc2af-1975-44f5-8a16-5a14415cdc10 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1689 microversion: 2.1 time: 0.161957 Aug 24 10:21:46.397437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 295/591] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:46 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:46.675138 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-77270c99-96f1-4730-afba-9ad3505d173d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:46.677474 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-77270c99-96f1-4730-afba-9ad3505d173d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:46.684210 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-77270c99-96f1-4730-afba-9ad3505d173d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:46.684689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-77270c99-96f1-4730-afba-9ad3505d173d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:46.685157 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-77270c99-96f1-4730-afba-9ad3505d173d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:46.685837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-77270c99-96f1-4730-afba-9ad3505d173d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:46.686279 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-77270c99-96f1-4730-afba-9ad3505d173d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:46.686699 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-77270c99-96f1-4730-afba-9ad3505d173d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:46.715213 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-77270c99-96f1-4730-afba-9ad3505d173d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043968 Aug 24 10:21:46.715883 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 297/592] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Aug 24 10:21:46 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:21:47.401333 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e190da03-f47a-4401-8fd3-82aa61d8c48e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:47.401955 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e190da03-f47a-4401-8fd3-82aa61d8c48e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:47.409350 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e190da03-f47a-4401-8fd3-82aa61d8c48e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:47.409838 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e190da03-f47a-4401-8fd3-82aa61d8c48e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:47.410278 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e190da03-f47a-4401-8fd3-82aa61d8c48e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:47.410971 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e190da03-f47a-4401-8fd3-82aa61d8c48e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:47.411463 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e190da03-f47a-4401-8fd3-82aa61d8c48e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:47.411891 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e190da03-f47a-4401-8fd3-82aa61d8c48e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:47.417596 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8dcaf6fe-adf4-4251-867c-3752e996ae45 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:47.418338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8dcaf6fe-adf4-4251-867c-3752e996ae45 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:47.420797 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:47.425415 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8dcaf6fe-adf4-4251-867c-3752e996ae45 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:47.425890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8dcaf6fe-adf4-4251-867c-3752e996ae45 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:47.426318 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8dcaf6fe-adf4-4251-867c-3752e996ae45 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:47.427008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8dcaf6fe-adf4-4251-867c-3752e996ae45 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:47.427450 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8dcaf6fe-adf4-4251-867c-3752e996ae45 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:47.427867 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8dcaf6fe-adf4-4251-867c-3752e996ae45 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:47.475175 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e190da03-f47a-4401-8fd3-82aa61d8c48e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:47.483319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e190da03-f47a-4401-8fd3-82aa61d8c48e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1289 microversion: 2.1 time: 0.085858 Aug 24 10:21:47.484107 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 296/593] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:47 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:47.558535 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8dcaf6fe-adf4-4251-867c-3752e996ae45 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:47.566506 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8dcaf6fe-adf4-4251-867c-3752e996ae45 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1689 microversion: 2.1 time: 0.152683 Aug 24 10:21:47.567085 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 298/594] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:47 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:47.727889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-51e21c20-de74-4b9d-8cae-00f4f08a9bc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:47.730083 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-51e21c20-de74-4b9d-8cae-00f4f08a9bc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:47.735988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-51e21c20-de74-4b9d-8cae-00f4f08a9bc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:47.736468 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-51e21c20-de74-4b9d-8cae-00f4f08a9bc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:47.736969 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-51e21c20-de74-4b9d-8cae-00f4f08a9bc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:47.737923 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-51e21c20-de74-4b9d-8cae-00f4f08a9bc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:47.738375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-51e21c20-de74-4b9d-8cae-00f4f08a9bc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:47.738796 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-51e21c20-de74-4b9d-8cae-00f4f08a9bc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:47.767874 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-51e21c20-de74-4b9d-8cae-00f4f08a9bc0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044064 Aug 24 10:21:47.768426 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 297/595] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Aug 24 10:21:47 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:21:48.504074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8f93bdfc-a115-4143-b9cf-d7dc1c8cdf98 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:48.504684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8f93bdfc-a115-4143-b9cf-d7dc1c8cdf98 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:48.511325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8f93bdfc-a115-4143-b9cf-d7dc1c8cdf98 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:48.511993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8f93bdfc-a115-4143-b9cf-d7dc1c8cdf98 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:48.512460 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8f93bdfc-a115-4143-b9cf-d7dc1c8cdf98 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:48.513201 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8f93bdfc-a115-4143-b9cf-d7dc1c8cdf98 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:48.513654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8f93bdfc-a115-4143-b9cf-d7dc1c8cdf98 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:48.514078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8f93bdfc-a115-4143-b9cf-d7dc1c8cdf98 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:48.576997 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8f93bdfc-a115-4143-b9cf-d7dc1c8cdf98 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:48.584656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8f93bdfc-a115-4143-b9cf-d7dc1c8cdf98 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1289 microversion: 2.1 time: 0.084383 Aug 24 10:21:48.585248 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 299/596] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:48 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:48.588640 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c327f993-9c67-4487-b8c5-7956dec8d48e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:48.589298 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c327f993-9c67-4487-b8c5-7956dec8d48e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:48.596511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c327f993-9c67-4487-b8c5-7956dec8d48e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:48.597022 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c327f993-9c67-4487-b8c5-7956dec8d48e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:48.597455 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c327f993-9c67-4487-b8c5-7956dec8d48e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:48.598149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c327f993-9c67-4487-b8c5-7956dec8d48e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:48.598598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c327f993-9c67-4487-b8c5-7956dec8d48e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:48.599017 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c327f993-9c67-4487-b8c5-7956dec8d48e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:48.730117 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c327f993-9c67-4487-b8c5-7956dec8d48e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:48.739192 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c327f993-9c67-4487-b8c5-7956dec8d48e tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1689 microversion: 2.1 time: 0.154314 Aug 24 10:21:48.739772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 298/597] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:48 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:48.780829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f6d025df-3f1a-4e9d-ac6a-5aea583c0253 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:48.783095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f6d025df-3f1a-4e9d-ac6a-5aea583c0253 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:48.788966 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f6d025df-3f1a-4e9d-ac6a-5aea583c0253 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:48.789439 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f6d025df-3f1a-4e9d-ac6a-5aea583c0253 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:48.789869 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f6d025df-3f1a-4e9d-ac6a-5aea583c0253 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:48.790544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f6d025df-3f1a-4e9d-ac6a-5aea583c0253 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:48.790991 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f6d025df-3f1a-4e9d-ac6a-5aea583c0253 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:48.791473 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f6d025df-3f1a-4e9d-ac6a-5aea583c0253 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:48.821853 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f6d025df-3f1a-4e9d-ac6a-5aea583c0253 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045564 Aug 24 10:21:48.822320 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 300/598] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Aug 24 10:21:48 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:21:49.604901 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-da5aaa4e-fb12-4cf0-8433-fb62accae157 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:49.606335 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-da5aaa4e-fb12-4cf0-8433-fb62accae157 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:49.612950 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-da5aaa4e-fb12-4cf0-8433-fb62accae157 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:49.613422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-da5aaa4e-fb12-4cf0-8433-fb62accae157 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:49.613850 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-da5aaa4e-fb12-4cf0-8433-fb62accae157 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:49.614523 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-da5aaa4e-fb12-4cf0-8433-fb62accae157 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:49.614977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-da5aaa4e-fb12-4cf0-8433-fb62accae157 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:49.615394 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-da5aaa4e-fb12-4cf0-8433-fb62accae157 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:49.678207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-da5aaa4e-fb12-4cf0-8433-fb62accae157 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:49.686582 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-da5aaa4e-fb12-4cf0-8433-fb62accae157 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1289 microversion: 2.1 time: 0.085520 Aug 24 10:21:49.687188 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 299/599] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:49 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:49.759481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bb0bc019-02a0-4b86-b085-683cc2ac2018 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:49.760094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bb0bc019-02a0-4b86-b085-683cc2ac2018 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:49.766627 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb0bc019-02a0-4b86-b085-683cc2ac2018 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:49.767097 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb0bc019-02a0-4b86-b085-683cc2ac2018 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:49.767523 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb0bc019-02a0-4b86-b085-683cc2ac2018 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:49.768202 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb0bc019-02a0-4b86-b085-683cc2ac2018 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:49.768647 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb0bc019-02a0-4b86-b085-683cc2ac2018 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:49.769116 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb0bc019-02a0-4b86-b085-683cc2ac2018 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:49.834341 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e247c02f-8219-4eab-8bab-5a1b74052f62 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:49.836508 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e247c02f-8219-4eab-8bab-5a1b74052f62 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:49.843104 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e247c02f-8219-4eab-8bab-5a1b74052f62 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:49.843590 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e247c02f-8219-4eab-8bab-5a1b74052f62 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:49.844064 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e247c02f-8219-4eab-8bab-5a1b74052f62 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:49.844761 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e247c02f-8219-4eab-8bab-5a1b74052f62 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:49.845294 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e247c02f-8219-4eab-8bab-5a1b74052f62 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:49.845723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e247c02f-8219-4eab-8bab-5a1b74052f62 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:49.877442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e247c02f-8219-4eab-8bab-5a1b74052f62 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046937 Aug 24 10:21:49.877889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 300/600] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Aug 24 10:21:49 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:21:49.908069 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bb0bc019-02a0-4b86-b085-683cc2ac2018 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:49.915706 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bb0bc019-02a0-4b86-b085-683cc2ac2018 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1689 microversion: 2.1 time: 0.160127 Aug 24 10:21:49.916264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 301/601] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:49 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:50.352633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-254d2041-bfa0-4afe-97e3-bc95f723f4b6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:50.353184 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-254d2041-bfa0-4afe-97e3-bc95f723f4b6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:50.359310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-254d2041-bfa0-4afe-97e3-bc95f723f4b6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:50.359798 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-254d2041-bfa0-4afe-97e3-bc95f723f4b6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:50.360231 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-254d2041-bfa0-4afe-97e3-bc95f723f4b6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:50.360998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-254d2041-bfa0-4afe-97e3-bc95f723f4b6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:50.361469 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-254d2041-bfa0-4afe-97e3-bc95f723f4b6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:50.361976 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-254d2041-bfa0-4afe-97e3-bc95f723f4b6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:50.385176 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-254d2041-bfa0-4afe-97e3-bc95f723f4b6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/ips" status: 200 len: 150 microversion: 2.1 time: 0.036605 Aug 24 10:21:50.385749 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 301/602] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Aug 24 10:21:50 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:50.707426 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3270261c-7349-4bbf-87c7-53ec93584144 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:50.708552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3270261c-7349-4bbf-87c7-53ec93584144 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:50.715117 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3270261c-7349-4bbf-87c7-53ec93584144 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:50.715591 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3270261c-7349-4bbf-87c7-53ec93584144 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:50.716018 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3270261c-7349-4bbf-87c7-53ec93584144 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:50.716714 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3270261c-7349-4bbf-87c7-53ec93584144 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:50.717184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3270261c-7349-4bbf-87c7-53ec93584144 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:50.717604 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3270261c-7349-4bbf-87c7-53ec93584144 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:50.814178 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3270261c-7349-4bbf-87c7-53ec93584144 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:50.822650 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3270261c-7349-4bbf-87c7-53ec93584144 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1297 microversion: 2.1 time: 0.118999 Aug 24 10:21:50.823558 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 302/603] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:50 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1297 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:50.890773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-17db2d00-1660-4479-8ad0-4f2c6c4b3e4f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:50.893529 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-17db2d00-1660-4479-8ad0-4f2c6c4b3e4f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:50.896070 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:50.900786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-17db2d00-1660-4479-8ad0-4f2c6c4b3e4f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:50.901601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-17db2d00-1660-4479-8ad0-4f2c6c4b3e4f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:50.903302 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-17db2d00-1660-4479-8ad0-4f2c6c4b3e4f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:50.904156 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-17db2d00-1660-4479-8ad0-4f2c6c4b3e4f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:50.904699 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-17db2d00-1660-4479-8ad0-4f2c6c4b3e4f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:50.905215 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-17db2d00-1660-4479-8ad0-4f2c6c4b3e4f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:50.938463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-be8f4248-4d72-4030-a02b-7391866d1e25 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:50.939971 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-be8f4248-4d72-4030-a02b-7391866d1e25 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:50.942536 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-17db2d00-1660-4479-8ad0-4f2c6c4b3e4f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056619 Aug 24 10:21:50.943268 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 302/604] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Aug 24 10:21:50 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:50.948592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be8f4248-4d72-4030-a02b-7391866d1e25 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:50.950846 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be8f4248-4d72-4030-a02b-7391866d1e25 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:50.951541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be8f4248-4d72-4030-a02b-7391866d1e25 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:50.953576 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be8f4248-4d72-4030-a02b-7391866d1e25 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:50.955946 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be8f4248-4d72-4030-a02b-7391866d1e25 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:50.956498 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be8f4248-4d72-4030-a02b-7391866d1e25 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.012013 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b391859f-19dd-4d21-876e-859a14e527ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:51.012496 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b391859f-19dd-4d21-876e-859a14e527ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:51.018399 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b391859f-19dd-4d21-876e-859a14e527ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:51.018920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b391859f-19dd-4d21-876e-859a14e527ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:51.019303 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b391859f-19dd-4d21-876e-859a14e527ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.019996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b391859f-19dd-4d21-876e-859a14e527ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:51.020446 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b391859f-19dd-4d21-876e-859a14e527ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:51.020928 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b391859f-19dd-4d21-876e-859a14e527ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.047566 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b391859f-19dd-4d21-876e-859a14e527ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:21:51.288408 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-be8f4248-4d72-4030-a02b-7391866d1e25 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:51.299078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-be8f4248-4d72-4030-a02b-7391866d1e25 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1689 microversion: 2.1 time: 0.364219 Aug 24 10:21:51.305533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 303/605] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:50 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1689 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:51.390385 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b391859f-19dd-4d21-876e-859a14e527ee tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 204 len: 0 microversion: 2.20 time: 0.382102 Aug 24 10:21:51.391187 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 303/606] 10.222.0.30 () {60 vars in 1280 bytes} [Wed Aug 24 10:21:51 2022] DELETE /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 10:21:51.399843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:51.400551 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:51.407774 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:51.408317 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:51.408775 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.409513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:51.409963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:51.410413 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.699270 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-cf9574d4-ec1c-4424-b782-182d5a6ab3f2 req-e601494d-a30b-466e-8577-aa96195987c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa35bff-3f3e-4a84-af4f-cdb62e5a4481", "name": "network-vif-deleted", "tag": "50a4db0b-fe10-4ecc-9fab-c39a1162c94a"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:51.710046 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:51.710448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-cf9574d4-ec1c-4424-b782-182d5a6ab3f2 req-e601494d-a30b-466e-8577-aa96195987c1 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:51.711036 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-cf9574d4-ec1c-4424-b782-182d5a6ab3f2 req-e601494d-a30b-466e-8577-aa96195987c1 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:51.711643 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-cf9574d4-ec1c-4424-b782-182d5a6ab3f2 req-e601494d-a30b-466e-8577-aa96195987c1 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.722384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:51.724349 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:51.725776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-51bcc2e4-99c8-4d65-9ea4-ae2c113a9efd tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.330204 Aug 24 10:21:51.726854 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 304/607] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:51 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:51.730011 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-cf9574d4-ec1c-4424-b782-182d5a6ab3f2 req-e601494d-a30b-466e-8577-aa96195987c1 service nova] Creating event network-vif-deleted:50a4db0b-fe10-4ecc-9fab-c39a1162c94a for instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 on hv-cinder-85427 Aug 24 10:21:51.737273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-cf9574d4-ec1c-4424-b782-182d5a6ab3f2 req-e601494d-a30b-466e-8577-aa96195987c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043303 Aug 24 10:21:51.738337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 304/608] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:21:51.844695 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-21f2c30c-a688-4e20-a2b4-f7983b32ecd7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:51.845501 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-21f2c30c-a688-4e20-a2b4-f7983b32ecd7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:51.852159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-21f2c30c-a688-4e20-a2b4-f7983b32ecd7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:51.852827 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-21f2c30c-a688-4e20-a2b4-f7983b32ecd7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:51.853500 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-21f2c30c-a688-4e20-a2b4-f7983b32ecd7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.854223 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-21f2c30c-a688-4e20-a2b4-f7983b32ecd7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:51.854679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-21f2c30c-a688-4e20-a2b4-f7983b32ecd7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:51.855140 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-21f2c30c-a688-4e20-a2b4-f7983b32ecd7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:51.926631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-21f2c30c-a688-4e20-a2b4-f7983b32ecd7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:51.934529 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-21f2c30c-a688-4e20-a2b4-f7983b32ecd7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1295 microversion: 2.1 time: 0.094587 Aug 24 10:21:51.935100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 305/609] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:51 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:52.229868 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9b47cd5c-447e-4144-acc6-b8fdcf1cd33c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2255e9-76dc-467c-be69-0645df965813"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:52.233640 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9b47cd5c-447e-4144-acc6-b8fdcf1cd33c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:52.240809 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b47cd5c-447e-4144-acc6-b8fdcf1cd33c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.256784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b47cd5c-447e-4144-acc6-b8fdcf1cd33c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.256784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b47cd5c-447e-4144-acc6-b8fdcf1cd33c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.256784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b47cd5c-447e-4144-acc6-b8fdcf1cd33c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.256784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b47cd5c-447e-4144-acc6-b8fdcf1cd33c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.257240 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b47cd5c-447e-4144-acc6-b8fdcf1cd33c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.319839 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f0a0d95c-96cc-456a-8847-454931b03d98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:52.320376 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f0a0d95c-96cc-456a-8847-454931b03d98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:52.326881 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f0a0d95c-96cc-456a-8847-454931b03d98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.327615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f0a0d95c-96cc-456a-8847-454931b03d98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.328245 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f0a0d95c-96cc-456a-8847-454931b03d98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.329328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f0a0d95c-96cc-456a-8847-454931b03d98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.329679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f0a0d95c-96cc-456a-8847-454931b03d98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.330092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f0a0d95c-96cc-456a-8847-454931b03d98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.334526 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:52.403294 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f0a0d95c-96cc-456a-8847-454931b03d98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:52.412716 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f0a0d95c-96cc-456a-8847-454931b03d98 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1622 microversion: 2.1 time: 0.096784 Aug 24 10:21:52.414324 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 306/610] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:52 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1622 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:52.751676 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:52.752200 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:52.759429 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.759912 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.760350 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.761078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.761554 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.762254 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.909147 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:52.919238 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:52.920685 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:52.921890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c76268d7-7fb7-47f5-9f07-607840dbf547 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.174283 Aug 24 10:21:52.922455 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 307/611] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:52 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:21:52.960142 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e72c9200-e7e8-47c3-a9e6-914fbf5b40a4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:52.960751 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-e72c9200-e7e8-47c3-a9e6-914fbf5b40a4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:52.967377 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e72c9200-e7e8-47c3-a9e6-914fbf5b40a4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.967862 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e72c9200-e7e8-47c3-a9e6-914fbf5b40a4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.968299 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e72c9200-e7e8-47c3-a9e6-914fbf5b40a4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:52.969094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e72c9200-e7e8-47c3-a9e6-914fbf5b40a4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:52.969534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e72c9200-e7e8-47c3-a9e6-914fbf5b40a4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:52.969961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e72c9200-e7e8-47c3-a9e6-914fbf5b40a4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:53.181909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e72c9200-e7e8-47c3-a9e6-914fbf5b40a4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:53.190251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e72c9200-e7e8-47c3-a9e6-914fbf5b40a4 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1363 microversion: 2.1 time: 0.233974 Aug 24 10:21:53.190865 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 308/612] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:52 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:53.434732 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:53.435349 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:53.441390 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:53.441874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:53.442316 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:53.443039 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:53.443499 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:53.443944 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:53.483514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:53.484037 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:53.484746 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:53.485424 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lazy-loading 'fault' on Instance uuid ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:21:53.629685 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:53.638906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1af5a4ec-3faf-416e-bd70-14a6c8434255 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 200 len: 1335 microversion: 2.1 time: 0.207745 Aug 24 10:21:53.640191 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 309/613] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:53 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 1335 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:53.873920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:53.895680 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=6 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:53.945091 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:53.949455 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:53.952759 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:53.953229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:53.953746 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:53.955433 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:53.955976 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:53.956572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:53.984164 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9b47cd5c-447e-4144-acc6-b8fdcf1cd33c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.759165 Aug 24 10:21:53.985199 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 305/614] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:21:52 2022] POST /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments => generated 194 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:54.134679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=6 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:54.213929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-dc829b17-2791-4205-8b3d-75dbb24b655e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:54.215691 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-dc829b17-2791-4205-8b3d-75dbb24b655e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:54.226246 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dc829b17-2791-4205-8b3d-75dbb24b655e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:54.227094 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dc829b17-2791-4205-8b3d-75dbb24b655e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:54.227767 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dc829b17-2791-4205-8b3d-75dbb24b655e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:54.229173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dc829b17-2791-4205-8b3d-75dbb24b655e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:54.229809 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dc829b17-2791-4205-8b3d-75dbb24b655e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:54.230949 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-dc829b17-2791-4205-8b3d-75dbb24b655e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:54.290786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:54.305687 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:54.307888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:54.309906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bae7f42c-940c-4403-8dfd-27f0f2c1d43e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1724 microversion: 2.20 time: 0.368436 Aug 24 10:21:54.311572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 310/615] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:53 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:54.389595 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-dc829b17-2791-4205-8b3d-75dbb24b655e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:54.397740 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-dc829b17-2791-4205-8b3d-75dbb24b655e tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1363 microversion: 2.1 time: 0.188894 Aug 24 10:21:54.398722 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 306/616] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:54 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:54.507346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-422c2263-a1ba-4d27-8a1d-729248c71c1c req-b8ab4243-b657-49f8-84ca-bdc9ff52413d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48253b3e-b4c6-433a-af33-f6e0b3bfb514", "tag": "b0757913-6b28-49a7-b3f0-287737878f96"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:54.518094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-422c2263-a1ba-4d27-8a1d-729248c71c1c req-b8ab4243-b657-49f8-84ca-bdc9ff52413d service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:54.518569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-422c2263-a1ba-4d27-8a1d-729248c71c1c req-b8ab4243-b657-49f8-84ca-bdc9ff52413d service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:54.519000 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-422c2263-a1ba-4d27-8a1d-729248c71c1c req-b8ab4243-b657-49f8-84ca-bdc9ff52413d service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:54.529906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-422c2263-a1ba-4d27-8a1d-729248c71c1c req-b8ab4243-b657-49f8-84ca-bdc9ff52413d service nova] Creating event network-changed:b0757913-6b28-49a7-b3f0-287737878f96 for instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 on hv-cinder-85427 Aug 24 10:21:54.534644 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-422c2263-a1ba-4d27-8a1d-729248c71c1c req-b8ab4243-b657-49f8-84ca-bdc9ff52413d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031011 Aug 24 10:21:54.535244 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 311/617] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:54.665144 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:54.665947 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: ffa35bff-3f3e-4a84-af4f-cdb62e5a4481] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:54.676393 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:54.678675 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:54.678675 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:54.678675 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:54.678675 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:54.679630 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:54.693440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] HTTP exception thrown: Instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 could not be found. Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Request method failure captured: Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 HTTP/1.1 Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfqeZL8TowYsedOYEynKAPOP9RwdHJIc2D-gELfWWCOmFE4l4co3BDidi-uSQEN7L1Eopi2D_J-scSLzQMafxChW6tVTjZzwAINMHAMdJkgGIX9f6AYn2sKPGG8VZdURC1cZvC1knKHb2lC5R8pG-zv0XHn6P3W5Q3vftEcgy2ZHOSU Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 66a7713fb6804b4db1fbd15fa71afa74 Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:21:54.695134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66a7713fb6804b4db1fbd15fa71afa74", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 66a7713fb6804b4db1fbd15fa71afa74 Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-ServerRescueNegativeTestJSON-314780275-project Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 388174c87a2245ca89a634f3b177e166 Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-ServerRescueNegativeTestJSON-314780275-project Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 could not be found. Aug 24 10:21:54.696760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': 'ffa35bff-3f3e-4a84-af4f-cdb62e5a4481'} Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 could not be found. Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:21:54.697586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 could not be found. Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 could not be found. Aug 24 10:21:54.698926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:21:54.705966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Returning 404 to user: Instance ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:21:54.705966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bc2f6a3c-22f5-4508-b664-979830fe6d0b tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481" status: 404 len: 111 microversion: 2.1 time: 0.035695 Aug 24 10:21:54.705966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 307/618] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:54 2022] GET /compute/v2.1/servers/ffa35bff-3f3e-4a84-af4f-cdb62e5a4481 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:21:54.707067 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-53301632-3a9b-48c5-bd2d-4efcf748eeef tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '.version_select at 0x7f0af4239a60>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:54.782465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-53301632-3a9b-48c5-bd2d-4efcf748eeef tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-260994801" status: 202 len: 0 microversion: 2.1 time: 0.079562 Aug 24 10:21:54.787656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 312/619] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Aug 24 10:21:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-260994801 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:21:55.334622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:55.335096 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:55.342230 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:55.342736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:55.343993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:55.344110 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:55.344548 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:55.344999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:55.376233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:55.424019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-fdcded99-810a-4f2b-bbcf-1da02ff4e13c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:55.426367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-fdcded99-810a-4f2b-bbcf-1da02ff4e13c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:55.432286 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:55.438702 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fdcded99-810a-4f2b-bbcf-1da02ff4e13c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:55.439463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fdcded99-810a-4f2b-bbcf-1da02ff4e13c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:55.440239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fdcded99-810a-4f2b-bbcf-1da02ff4e13c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:55.441731 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fdcded99-810a-4f2b-bbcf-1da02ff4e13c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:55.442365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fdcded99-810a-4f2b-bbcf-1da02ff4e13c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:55.442956 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fdcded99-810a-4f2b-bbcf-1da02ff4e13c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:55.444424 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:55.445969 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:55.449473 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f4aef867-ddcb-41c9-aea7-59f4911a3c4d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1656 microversion: 2.20 time: 0.116814 Aug 24 10:21:55.453824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 308/620] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:55 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1656 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:55.686767 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-fdcded99-810a-4f2b-bbcf-1da02ff4e13c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:55.699367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-fdcded99-810a-4f2b-bbcf-1da02ff4e13c tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1363 microversion: 2.1 time: 0.282410 Aug 24 10:21:55.699952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 313/621] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:55 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:56.476168 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:56.476784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:56.484337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:56.484850 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:56.485310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:56.485999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:56.486453 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:56.487012 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:56.520459 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:56.520977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:56.521417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:56.521863 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lazy-loading 'fault' on Instance uuid ac36f3b6-c66c-406b-b472-0a2dd018d4c3 {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:21:56.550158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-fddfe763-c097-4445-baf1-1b296ddfc729 req-88d7a688-365a-4d7a-9414-b1f1cd2b9695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac36f3b6-c66c-406b-b472-0a2dd018d4c3", "name": "network-vif-deleted", "tag": "9fdb04de-4902-4316-8683-e37dc854e2b3"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:56.561236 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-fddfe763-c097-4445-baf1-1b296ddfc729 req-88d7a688-365a-4d7a-9414-b1f1cd2b9695 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:56.561908 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-fddfe763-c097-4445-baf1-1b296ddfc729 req-88d7a688-365a-4d7a-9414-b1f1cd2b9695 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:56.562340 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-fddfe763-c097-4445-baf1-1b296ddfc729 req-88d7a688-365a-4d7a-9414-b1f1cd2b9695 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:56.567699 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:56.573604 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-fddfe763-c097-4445-baf1-1b296ddfc729 req-88d7a688-365a-4d7a-9414-b1f1cd2b9695 service nova] Creating event network-vif-deleted:9fdb04de-4902-4316-8683-e37dc854e2b3 for instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 on hv-cinder-85427 Aug 24 10:21:56.576055 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:56.577947 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:56.578541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-fddfe763-c097-4445-baf1-1b296ddfc729 req-88d7a688-365a-4d7a-9414-b1f1cd2b9695 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031880 Aug 24 10:21:56.579436 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-02cbb8d6-1c83-4d81-9e95-1a8bd2356151 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 200 len: 1371 microversion: 2.20 time: 0.107012 Aug 24 10:21:56.579555 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 314/622] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:21:56.579694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 309/623] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:56 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:21:56.720926 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1aee24c5-9dab-4599-9219-77c8a7b71e12 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:56.721539 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1aee24c5-9dab-4599-9219-77c8a7b71e12 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:56.727789 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1aee24c5-9dab-4599-9219-77c8a7b71e12 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:56.728266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1aee24c5-9dab-4599-9219-77c8a7b71e12 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:56.728713 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1aee24c5-9dab-4599-9219-77c8a7b71e12 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:56.729463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1aee24c5-9dab-4599-9219-77c8a7b71e12 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:56.729913 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1aee24c5-9dab-4599-9219-77c8a7b71e12 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:56.734176 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1aee24c5-9dab-4599-9219-77c8a7b71e12 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:56.865171 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1aee24c5-9dab-4599-9219-77c8a7b71e12 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:56.873403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1aee24c5-9dab-4599-9219-77c8a7b71e12 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1363 microversion: 2.1 time: 0.156802 Aug 24 10:21:56.873975 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 315/624] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:56 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:57.602276 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:57.602883 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:57.609843 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:57.626132 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:57.626132 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:57.626132 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:57.626132 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:57.626622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:57.626622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] HTTP exception thrown: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Request method failure captured: Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 HTTP/1.1 Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfr2dTVrYbhvg-XS6yk4rxeOQxdi7BW0_2_ujp5KXpdzvI3JxACKwzgfOXMejML0tmzbkZE2RXmfffyo4jhZx7YzRzR0WyvjOtN593QcnwQD5Zhc3ZWpiuOVuNklXZNwJh_1empr8q28jkHCkM4dFXpmS6PtbTzThLtcj62HL_AYNro Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:21:57.627893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad90b6c7dd947dda6faa1fc1feb6d7b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 8d72e2cc5b804b0bb556599a26d923ac Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:21:57.629487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': 'ac36f3b6-c66c-406b-b472-0a2dd018d4c3'} Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:21:57.630824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:21:57.632349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:21:57.633773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Returning 404 to user: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:21:57.633773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f8ec5f27-d8a8-48df-88ca-79b1e8151334 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 404 len: 111 microversion: 2.20 time: 0.031335 Aug 24 10:21:57.633773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 310/625] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:21:57 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:21:57.640541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e36c2f43-30ae-45d4-95e2-12267dac2bca tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '.version_select at 0x7f0af4304310>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:57.733814 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e36c2f43-30ae-45d4-95e2-12267dac2bca tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089256025" status: 204 len: 0 microversion: 2.20 time: 0.098433 Aug 24 10:21:57.734469 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 316/626] 10.222.0.30 () {60 vars in 1262 bytes} [Wed Aug 24 10:21:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089256025 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:21:57.896295 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2737e2b3-1690-4da9-8d24-495bb9e8d313 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:57.896901 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2737e2b3-1690-4da9-8d24-495bb9e8d313 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:57.903624 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2737e2b3-1690-4da9-8d24-495bb9e8d313 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:57.904130 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2737e2b3-1690-4da9-8d24-495bb9e8d313 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:57.904596 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2737e2b3-1690-4da9-8d24-495bb9e8d313 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:57.905336 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2737e2b3-1690-4da9-8d24-495bb9e8d313 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:57.905796 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2737e2b3-1690-4da9-8d24-495bb9e8d313 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:57.906225 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2737e2b3-1690-4da9-8d24-495bb9e8d313 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:58.159835 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2737e2b3-1690-4da9-8d24-495bb9e8d313 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:58.165237 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2737e2b3-1690-4da9-8d24-495bb9e8d313 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1363 microversion: 2.1 time: 0.273188 Aug 24 10:21:58.166277 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 311/627] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:57 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:58.547312 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a274a3cf-98ff-43b2-b7dc-050dbe44186a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:58.547803 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a274a3cf-98ff-43b2-b7dc-050dbe44186a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:58.553640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a274a3cf-98ff-43b2-b7dc-050dbe44186a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:58.554117 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a274a3cf-98ff-43b2-b7dc-050dbe44186a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:58.554544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a274a3cf-98ff-43b2-b7dc-050dbe44186a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:58.555224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a274a3cf-98ff-43b2-b7dc-050dbe44186a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:58.555673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a274a3cf-98ff-43b2-b7dc-050dbe44186a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:58.556087 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a274a3cf-98ff-43b2-b7dc-050dbe44186a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:58.581724 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a274a3cf-98ff-43b2-b7dc-050dbe44186a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Going to try to terminate instance {{(pid=121270) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:21:58.598953 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e32708a1-5e41-43bd-858d-daaddee7a6f7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Action: 'create', calling method: .version_select at 0x7f0af40c1160>, body: {"keypair": {"name": "tempest-keypair-2034883282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJivgn25H5LjMFp3D/RLtN7nfXI+nbz7D+47tyZkvjnNEssfCSc2doJyxUBTXHYqEymIJfxVxHeGQh6apxlMbt++DhNfHXmYETdVcHkLrn20NC0q9p/r36QaOH9TEflGsQ=="}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:58.614972 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-e32708a1-5e41-43bd-858d-daaddee7a6f7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Getting quotas for project dad90b6c7dd947dda6faa1fc1feb6d7b. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:21:58.618915 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-e32708a1-5e41-43bd-858d-daaddee7a6f7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Getting quotas for user 8d72e2cc5b804b0bb556599a26d923ac and project dad90b6c7dd947dda6faa1fc1feb6d7b. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:21:58.750155 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e32708a1-5e41-43bd-858d-daaddee7a6f7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.154896 Aug 24 10:21:58.750732 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 312/628] 10.222.0.30 () {62 vars in 1200 bytes} [Wed Aug 24 10:21:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 10:21:58.943663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a274a3cf-98ff-43b2-b7dc-050dbe44186a tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 204 len: 0 microversion: 2.1 time: 0.400652 Aug 24 10:21:58.944280 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 317/629] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:21:58 2022] DELETE /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:21:58.953291 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-636e3dc9-0319-4909-9bf3-6873570aae39 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:58.953910 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-636e3dc9-0319-4909-9bf3-6873570aae39 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:58.959945 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-636e3dc9-0319-4909-9bf3-6873570aae39 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:58.960452 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-636e3dc9-0319-4909-9bf3-6873570aae39 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:58.961108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-636e3dc9-0319-4909-9bf3-6873570aae39 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:58.961798 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-636e3dc9-0319-4909-9bf3-6873570aae39 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:58.962259 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-636e3dc9-0319-4909-9bf3-6873570aae39 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:58.962681 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-636e3dc9-0319-4909-9bf3-6873570aae39 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:59.121635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-636e3dc9-0319-4909-9bf3-6873570aae39 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:59.130022 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-636e3dc9-0319-4909-9bf3-6873570aae39 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1508 microversion: 2.1 time: 0.181537 Aug 24 10:21:59.130720 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 313/630] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:58 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:59.196382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1420d312-e36b-457a-9a73-f7d815533581 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:59.197229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1420d312-e36b-457a-9a73-f7d815533581 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:59.204174 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1420d312-e36b-457a-9a73-f7d815533581 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:59.204687 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1420d312-e36b-457a-9a73-f7d815533581 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:59.205209 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1420d312-e36b-457a-9a73-f7d815533581 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:59.205823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1420d312-e36b-457a-9a73-f7d815533581 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:59.206275 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1420d312-e36b-457a-9a73-f7d815533581 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:59.206692 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1420d312-e36b-457a-9a73-f7d815533581 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:59.341952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1420d312-e36b-457a-9a73-f7d815533581 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:59.350129 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1420d312-e36b-457a-9a73-f7d815533581 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1363 microversion: 2.1 time: 0.158022 Aug 24 10:21:59.350903 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 318/631] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:59 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:59.771832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-11b8431b-3e5e-4fee-97a7-7b57be7cfa38 req-70feb79e-34cd-4882-9cc1-5f2588efe7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48253b3e-b4c6-433a-af33-f6e0b3bfb514", "name": "network-vif-plugged", "status": "completed", "tag": "b0757913-6b28-49a7-b3f0-287737878f96"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:59.784212 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-11b8431b-3e5e-4fee-97a7-7b57be7cfa38 req-70feb79e-34cd-4882-9cc1-5f2588efe7ea service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:59.784716 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-11b8431b-3e5e-4fee-97a7-7b57be7cfa38 req-70feb79e-34cd-4882-9cc1-5f2588efe7ea service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:59.785737 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-11b8431b-3e5e-4fee-97a7-7b57be7cfa38 req-70feb79e-34cd-4882-9cc1-5f2588efe7ea service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:59.796988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-11b8431b-3e5e-4fee-97a7-7b57be7cfa38 req-70feb79e-34cd-4882-9cc1-5f2588efe7ea service nova] Creating event network-vif-plugged:b0757913-6b28-49a7-b3f0-287737878f96 for instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 on hv-cinder-85427 Aug 24 10:21:59.801843 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-11b8431b-3e5e-4fee-97a7-7b57be7cfa38 req-70feb79e-34cd-4882-9cc1-5f2588efe7ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033705 Aug 24 10:21:59.802409 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 314/632] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:00.151668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5f093ab7-2a80-4cbe-af3d-321c92cbaf1c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:00.153155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5f093ab7-2a80-4cbe-af3d-321c92cbaf1c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:00.159949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f093ab7-2a80-4cbe-af3d-321c92cbaf1c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:00.160433 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f093ab7-2a80-4cbe-af3d-321c92cbaf1c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:00.160885 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f093ab7-2a80-4cbe-af3d-321c92cbaf1c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:00.161645 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f093ab7-2a80-4cbe-af3d-321c92cbaf1c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:00.162096 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f093ab7-2a80-4cbe-af3d-321c92cbaf1c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:00.162599 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f093ab7-2a80-4cbe-af3d-321c92cbaf1c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:00.296609 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5f093ab7-2a80-4cbe-af3d-321c92cbaf1c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:00.304833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5f093ab7-2a80-4cbe-af3d-321c92cbaf1c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1508 microversion: 2.1 time: 0.157095 Aug 24 10:22:00.305855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 319/633] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:00 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:00.372758 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-897eca00-0a8b-4461-ae16-451898c2b6c6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:00.373582 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-897eca00-0a8b-4461-ae16-451898c2b6c6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:00.380052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-897eca00-0a8b-4461-ae16-451898c2b6c6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:00.380479 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-897eca00-0a8b-4461-ae16-451898c2b6c6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:00.381015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-897eca00-0a8b-4461-ae16-451898c2b6c6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:00.381717 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-897eca00-0a8b-4461-ae16-451898c2b6c6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:00.382175 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-897eca00-0a8b-4461-ae16-451898c2b6c6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:00.382600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-897eca00-0a8b-4461-ae16-451898c2b6c6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:00.634394 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-897eca00-0a8b-4461-ae16-451898c2b6c6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:00.642633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-897eca00-0a8b-4461-ae16-451898c2b6c6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1363 microversion: 2.1 time: 0.274456 Aug 24 10:22:00.643212 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 315/634] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:00 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:01.319343 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-703976899", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "721eb6da-ac9c-4e0f-a47b-98c8e8d18efa"}], "security_groups": [{"name": "tempest-securitygroup--1537433437"}], "key_name": "tempest-keypair-2034883282", "user_data": "}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:01.326529 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d97e836f-15aa-4081-88f1-9255a8649c88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:01.327359 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d97e836f-15aa-4081-88f1-9255a8649c88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:01.333423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d97e836f-15aa-4081-88f1-9255a8649c88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:01.333907 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d97e836f-15aa-4081-88f1-9255a8649c88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:01.334338 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d97e836f-15aa-4081-88f1-9255a8649c88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:01.335034 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d97e836f-15aa-4081-88f1-9255a8649c88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:01.335485 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d97e836f-15aa-4081-88f1-9255a8649c88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:01.335950 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d97e836f-15aa-4081-88f1-9255a8649c88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:01.440613 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] validate_networks() for [('721eb6da-ac9c-4e0f-a47b-98c8e8d18efa', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:22:01.478459 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d97e836f-15aa-4081-88f1-9255a8649c88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:01.489507 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d97e836f-15aa-4081-88f1-9255a8649c88 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1508 microversion: 2.1 time: 0.167041 Aug 24 10:22:01.501057 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 316/635] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:01 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:01.663749 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-15d7efdf-43e1-4310-96a5-83e3e06a5073 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:01.664361 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-15d7efdf-43e1-4310-96a5-83e3e06a5073 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:01.671032 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-15d7efdf-43e1-4310-96a5-83e3e06a5073 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:01.671511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-15d7efdf-43e1-4310-96a5-83e3e06a5073 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:01.671938 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-15d7efdf-43e1-4310-96a5-83e3e06a5073 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:01.672622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-15d7efdf-43e1-4310-96a5-83e3e06a5073 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:01.673100 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-15d7efdf-43e1-4310-96a5-83e3e06a5073 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:01.673518 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-15d7efdf-43e1-4310-96a5-83e3e06a5073 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:01.812762 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-15d7efdf-43e1-4310-96a5-83e3e06a5073 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:01.820920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-15d7efdf-43e1-4310-96a5-83e3e06a5073 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1363 microversion: 2.1 time: 0.160876 Aug 24 10:22:01.821521 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 317/636] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:01 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:01.902750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:22:01.903809 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:22:01.903809 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:22:01.904090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:22:01.904503 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:22:01.913527 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:01.917257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:01.917257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:01.917257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:01.917257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:01.918253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:01.933586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Getting quotas for project dad90b6c7dd947dda6faa1fc1feb6d7b. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:01.937525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Getting quotas for user 8d72e2cc5b804b0bb556599a26d923ac and project dad90b6c7dd947dda6faa1fc1feb6d7b. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:01.948412 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:22:01.951008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:22:02.076966 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-62c06236-65d7-4d02-8228-3a5e8f0aab23 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.761717 Aug 24 10:22:02.077563 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 320/637] 10.222.0.30 () {62 vars in 1188 bytes} [Wed Aug 24 10:22:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 10:22:02.088561 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7b3e308b-9c1b-491e-9e37-9342dccedcf3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:02.089194 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7b3e308b-9c1b-491e-9e37-9342dccedcf3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:02.158743 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7b3e308b-9c1b-491e-9e37-9342dccedcf3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:02.173434 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7b3e308b-9c1b-491e-9e37-9342dccedcf3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:02.175602 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7b3e308b-9c1b-491e-9e37-9342dccedcf3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:02.177124 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7b3e308b-9c1b-491e-9e37-9342dccedcf3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1281 microversion: 2.20 time: 0.092330 Aug 24 10:22:02.178013 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 318/638] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:02 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:02.512591 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4aaf45a4-a78d-4360-b7dd-a5c6a6382471 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:02.513235 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4aaf45a4-a78d-4360-b7dd-a5c6a6382471 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:02.520041 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4aaf45a4-a78d-4360-b7dd-a5c6a6382471 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:02.520815 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4aaf45a4-a78d-4360-b7dd-a5c6a6382471 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:02.521271 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4aaf45a4-a78d-4360-b7dd-a5c6a6382471 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:02.522161 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4aaf45a4-a78d-4360-b7dd-a5c6a6382471 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:02.522623 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4aaf45a4-a78d-4360-b7dd-a5c6a6382471 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:02.523048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4aaf45a4-a78d-4360-b7dd-a5c6a6382471 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:02.800172 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-130246b7-3ede-4642-b263-0970346dd84d req-9446fd14-0994-4c86-984d-35d76c6ce7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5bafeb-d393-4bf8-8c9e-734f9f9b926c", "name": "network-vif-deleted", "tag": "4f928fdd-869d-4aed-a4ce-3d41cd7ec567"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:02.816934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4aaf45a4-a78d-4360-b7dd-a5c6a6382471 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:02.826097 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-130246b7-3ede-4642-b263-0970346dd84d req-9446fd14-0994-4c86-984d-35d76c6ce7f7 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:02.826438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-130246b7-3ede-4642-b263-0970346dd84d req-9446fd14-0994-4c86-984d-35d76c6ce7f7 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:02.827073 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-130246b7-3ede-4642-b263-0970346dd84d req-9446fd14-0994-4c86-984d-35d76c6ce7f7 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:02.835070 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4aaf45a4-a78d-4360-b7dd-a5c6a6382471 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1508 microversion: 2.1 time: 0.327311 Aug 24 10:22:02.836551 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 321/639] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:02 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:02.843052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-130246b7-3ede-4642-b263-0970346dd84d req-9446fd14-0994-4c86-984d-35d76c6ce7f7 service nova] Creating event network-vif-deleted:4f928fdd-869d-4aed-a4ce-3d41cd7ec567 for instance 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c on hv-cinder-85427 Aug 24 10:22:02.845516 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a499305a-1858-47cf-b80f-0db698f40fe7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:02.846333 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a499305a-1858-47cf-b80f-0db698f40fe7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:02.849860 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-130246b7-3ede-4642-b263-0970346dd84d req-9446fd14-0994-4c86-984d-35d76c6ce7f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052957 Aug 24 10:22:02.851113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 319/640] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:02.860811 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a499305a-1858-47cf-b80f-0db698f40fe7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:02.861174 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a499305a-1858-47cf-b80f-0db698f40fe7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:02.862610 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a499305a-1858-47cf-b80f-0db698f40fe7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:02.866627 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a499305a-1858-47cf-b80f-0db698f40fe7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:02.866627 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a499305a-1858-47cf-b80f-0db698f40fe7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:02.866627 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a499305a-1858-47cf-b80f-0db698f40fe7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:03.008592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a499305a-1858-47cf-b80f-0db698f40fe7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:03.018304 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a499305a-1858-47cf-b80f-0db698f40fe7 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1363 microversion: 2.1 time: 0.179858 Aug 24 10:22:03.020948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 322/641] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:02 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:03.202385 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9d4dee80-7304-4198-8c9f-bfdfed5c4507 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:03.204164 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9d4dee80-7304-4198-8c9f-bfdfed5c4507 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:03.298546 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9d4dee80-7304-4198-8c9f-bfdfed5c4507 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:03.307177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9d4dee80-7304-4198-8c9f-bfdfed5c4507 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:03.309346 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9d4dee80-7304-4198-8c9f-bfdfed5c4507 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:03.310576 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9d4dee80-7304-4198-8c9f-bfdfed5c4507 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1281 microversion: 2.20 time: 0.113970 Aug 24 10:22:03.311147 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 320/642] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:03 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:03.725892 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2255e9-76dc-467c-be69-0645df965813"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:03.728842 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:03.735876 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:03.736367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:03.736809 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:03.737787 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:03.738241 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:03.738665 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:03.818962 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Invalid volume: volume 6c2255e9-76dc-467c-be69-0645df965813 is already attached to instances: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: POST /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments HTTP/1.1 Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 74 Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:22:03.820673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {"volumeAttachment": {"volumeId": "6c2255e9-76dc-467c-be69-0645df965813"}} Aug 24 10:22:03.822207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Invalid volume: volume 6c2255e9-76dc-467c-be69-0645df965813 is already attached to instances: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'server_id': 'cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1', 'body': {'volumeAttachment': {'volumeId': '6c2255e9-76dc-467c-be69-0645df965813'}}} Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6c2255e9-76dc-467c-be69-0645df965813 is already attached to instances: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:03.823158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6c2255e9-76dc-467c-be69-0645df965813 is already attached to instances: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:03.825188 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:03.826934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:03.826934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:03.826934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:03.826934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6c2255e9-76dc-467c-be69-0645df965813 is already attached to instances: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 Aug 24 10:22:03.826934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:03.826934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 400 to user: Invalid volume: volume 6c2255e9-76dc-467c-be69-0645df965813 is already attached to instances: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:03.826934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-85d8b7ad-a08b-4826-bac6-9c38fcfe17d3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100402 Aug 24 10:22:03.826934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 323/643] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:22:03 2022] POST /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:22:03.861609 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:03.862253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:03.897786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:03.897786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:03.897786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:03.897786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:03.898403 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:03.898403 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:03.898597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f77739d8-0d29-45ac-929b-d4c419f7712e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:03.898597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f77739d8-0d29-45ac-929b-d4c419f7712e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:03.898597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f77739d8-0d29-45ac-929b-d4c419f7712e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:03.898597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f77739d8-0d29-45ac-929b-d4c419f7712e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:03.898939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f77739d8-0d29-45ac-929b-d4c419f7712e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:03.898939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f77739d8-0d29-45ac-929b-d4c419f7712e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:03.898939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f77739d8-0d29-45ac-929b-d4c419f7712e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:03.899302 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f77739d8-0d29-45ac-929b-d4c419f7712e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:03.906397 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:03.906888 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:03.907325 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:03.907773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lazy-loading 'fault' on Instance uuid 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:22:03.950032 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:03.958422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-929ec5c1-24c7-4050-8e2d-6a2e4aaca0ee tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1312 microversion: 2.1 time: 0.100909 Aug 24 10:22:03.960095 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 321/644] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:03 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:03.985553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:03.989611 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-f77739d8-0d29-45ac-929b-d4c419f7712e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lazy-loading 'services' on Instance uuid cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:22:04.039136 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a2440061-44e0-44cd-8978-47054eaff512 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:04.039757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a2440061-44e0-44cd-8978-47054eaff512 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:04.047177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2440061-44e0-44cd-8978-47054eaff512 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:04.047795 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2440061-44e0-44cd-8978-47054eaff512 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:04.048266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2440061-44e0-44cd-8978-47054eaff512 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:04.049064 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2440061-44e0-44cd-8978-47054eaff512 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:04.049579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2440061-44e0-44cd-8978-47054eaff512 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:04.050013 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2440061-44e0-44cd-8978-47054eaff512 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:04.189392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a2440061-44e0-44cd-8978-47054eaff512 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:04.197208 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a2440061-44e0-44cd-8978-47054eaff512 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1550 microversion: 2.1 time: 0.162046 Aug 24 10:22:04.198304 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 322/645] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:04 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:04.217657 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-25106580-a111-4151-b4f0-b101c8299286 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:04.218151 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-25106580-a111-4151-b4f0-b101c8299286 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:04.224043 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-25106580-a111-4151-b4f0-b101c8299286 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:04.224528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-25106580-a111-4151-b4f0-b101c8299286 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:04.224995 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-25106580-a111-4151-b4f0-b101c8299286 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:04.225691 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-25106580-a111-4151-b4f0-b101c8299286 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:04.226277 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-25106580-a111-4151-b4f0-b101c8299286 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:04.226754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-25106580-a111-4151-b4f0-b101c8299286 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:04.302947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f77739d8-0d29-45ac-929b-d4c419f7712e tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments/6c2255e9-76dc-467c-be69-0645df965813" status: 202 len: 0 microversion: 2.1 time: 0.417306 Aug 24 10:22:04.303579 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 324/646] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:22:03 2022] DELETE /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments/6c2255e9-76dc-467c-be69-0645df965813 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:22:04.303909 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-25106580-a111-4151-b4f0-b101c8299286 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090198 Aug 24 10:22:04.304492 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 323/647] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Aug 24 10:22:04 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:04.312898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-08956685-b121-4d85-8d1e-2c2e06440009 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:04.315278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-08956685-b121-4d85-8d1e-2c2e06440009 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:04.321963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-08956685-b121-4d85-8d1e-2c2e06440009 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:04.322450 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-08956685-b121-4d85-8d1e-2c2e06440009 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:04.322889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-08956685-b121-4d85-8d1e-2c2e06440009 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:04.323637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-08956685-b121-4d85-8d1e-2c2e06440009 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:04.324834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-08956685-b121-4d85-8d1e-2c2e06440009 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:04.325291 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-08956685-b121-4d85-8d1e-2c2e06440009 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:04.333851 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:04.334875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:04.344115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:04.345042 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:04.345626 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:04.346420 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:04.347115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:04.347626 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:04.360464 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-08956685-b121-4d85-8d1e-2c2e06440009 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052494 Aug 24 10:22:04.361077 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 325/648] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:22:04 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:04.449606 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:04.457770 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:04.459588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:04.460704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-11da4f01-9ce1-44e6-861e-d428e748c76a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1277 microversion: 2.20 time: 0.132821 Aug 24 10:22:04.461279 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 324/649] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:04 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:22:04.980068 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:04.981482 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:04.989257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:04.989822 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:04.990350 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:04.991150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:04.991822 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:04.992339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:05.026082 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:05.026515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:05.027465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:05.027917 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lazy-loading 'fault' on Instance uuid 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:22:05.072395 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:05.080378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-339757e6-6eea-4920-b126-251600b27219 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 200 len: 1312 microversion: 2.1 time: 0.104434 Aug 24 10:22:05.080993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 326/650] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:04 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:05.373478 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-58dd1be9-8b64-40e4-b926-f8231728bc29 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:05.375682 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-58dd1be9-8b64-40e4-b926-f8231728bc29 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:05.382226 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58dd1be9-8b64-40e4-b926-f8231728bc29 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:05.382705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58dd1be9-8b64-40e4-b926-f8231728bc29 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:05.383134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58dd1be9-8b64-40e4-b926-f8231728bc29 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:05.383858 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58dd1be9-8b64-40e4-b926-f8231728bc29 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:05.384308 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58dd1be9-8b64-40e4-b926-f8231728bc29 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:05.384729 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58dd1be9-8b64-40e4-b926-f8231728bc29 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:05.416458 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-58dd1be9-8b64-40e4-b926-f8231728bc29 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 Aug 24 10:22:05.417071 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 325/651] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:22:05 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:05.484183 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:05.484796 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:05.496329 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:05.497049 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:05.497492 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:05.498239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:05.498689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:05.499112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:05.615125 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:05.619228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-fe7d1ce5-a1a4-4b01-b110-14ec113e5e3e req-25a4213c-d6c4-4eb5-9558-4faaba88cdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48253b3e-b4c6-433a-af33-f6e0b3bfb514", "tag": "b0757913-6b28-49a7-b3f0-287737878f96"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:05.628049 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:05.630180 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:05.631594 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4bcfc804-ad53-4101-aa2c-70177bb3489c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1333 microversion: 2.20 time: 0.151848 Aug 24 10:22:05.632664 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 327/652] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:05 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1333 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:05.636074 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fe7d1ce5-a1a4-4b01-b110-14ec113e5e3e req-25a4213c-d6c4-4eb5-9558-4faaba88cdf5 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:05.637698 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fe7d1ce5-a1a4-4b01-b110-14ec113e5e3e req-25a4213c-d6c4-4eb5-9558-4faaba88cdf5 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:05.638410 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fe7d1ce5-a1a4-4b01-b110-14ec113e5e3e req-25a4213c-d6c4-4eb5-9558-4faaba88cdf5 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:05.650284 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-fe7d1ce5-a1a4-4b01-b110-14ec113e5e3e req-25a4213c-d6c4-4eb5-9558-4faaba88cdf5 service nova] Creating event network-changed:b0757913-6b28-49a7-b3f0-287737878f96 for instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 on hv-cinder-85427 Aug 24 10:22:05.657066 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-fe7d1ce5-a1a4-4b01-b110-14ec113e5e3e req-25a4213c-d6c4-4eb5-9558-4faaba88cdf5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041428 Aug 24 10:22:05.660403 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 326/653] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:06.108371 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:06.109141 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:06.119157 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.120229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.121630 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.123293 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.124167 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.124799 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.140169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] HTTP exception thrown: Instance 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c could not be found. Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Request method failure captured: Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c HTTP/1.1 Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqeZL8TowYsedOYEynKAPOP9RwdHJIc2D-gELfWWCOmFE4l4co3BDidi-uSQEN7L1Eopi2D_J-scSLzQMafxChW6tVTjZzwAINMHAMdJkgGIX9f6AYn2sKPGG8VZdURC1cZvC1knKHb2lC5R8pG-zv0XHn6P3W5Q3vftEcgy2ZHOSU Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 66a7713fb6804b4db1fbd15fa71afa74 Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:22:06.142060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66a7713fb6804b4db1fbd15fa71afa74", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 66a7713fb6804b4db1fbd15fa71afa74 Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-ServerRescueNegativeTestJSON-314780275-project Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 388174c87a2245ca89a634f3b177e166 Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-ServerRescueNegativeTestJSON-314780275-project Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c could not be found. Aug 24 10:22:06.143557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '4b5bafeb-d393-4bf8-8c9e-734f9f9b926c'} Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c could not be found. Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:06.144445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c could not be found. Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c could not be found. Aug 24 10:22:06.145943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:06.147267 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Returning 404 to user: Instance 4b5bafeb-d393-4bf8-8c9e-734f9f9b926c could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:06.147267 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2af56a11-52a4-4a18-a803-82669a34ac5c tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c" status: 404 len: 111 microversion: 2.1 time: 0.042234 Aug 24 10:22:06.148998 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 328/654] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:06 2022] GET /compute/v2.1/servers/4b5bafeb-d393-4bf8-8c9e-734f9f9b926c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:06.153554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0ee08ea4-0aaa-4ae9-a595-3f9cfd846226 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:06.154137 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0ee08ea4-0aaa-4ae9-a595-3f9cfd846226 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:06.160404 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0ee08ea4-0aaa-4ae9-a595-3f9cfd846226 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.160918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0ee08ea4-0aaa-4ae9-a595-3f9cfd846226 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.161358 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0ee08ea4-0aaa-4ae9-a595-3f9cfd846226 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.162054 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0ee08ea4-0aaa-4ae9-a595-3f9cfd846226 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.162503 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0ee08ea4-0aaa-4ae9-a595-3f9cfd846226 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.162963 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0ee08ea4-0aaa-4ae9-a595-3f9cfd846226 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.190420 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0ee08ea4-0aaa-4ae9-a595-3f9cfd846226 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:06.429788 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-dd06f2ac-48f4-433a-87e3-0c8f3a038e75 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:06.432407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-dd06f2ac-48f4-433a-87e3-0c8f3a038e75 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:06.443172 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd06f2ac-48f4-433a-87e3-0c8f3a038e75 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.443885 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd06f2ac-48f4-433a-87e3-0c8f3a038e75 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.445351 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd06f2ac-48f4-433a-87e3-0c8f3a038e75 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.450098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd06f2ac-48f4-433a-87e3-0c8f3a038e75 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.450098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd06f2ac-48f4-433a-87e3-0c8f3a038e75 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.450098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd06f2ac-48f4-433a-87e3-0c8f3a038e75 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.487944 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-dd06f2ac-48f4-433a-87e3-0c8f3a038e75 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062425 Aug 24 10:22:06.489061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 329/655] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:22:06 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:22:06.558682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d0fdd45d-003a-4c44-a79b-04466537ad56 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:06.562909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d0fdd45d-003a-4c44-a79b-04466537ad56 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:06.567293 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0fdd45d-003a-4c44-a79b-04466537ad56 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.568118 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0fdd45d-003a-4c44-a79b-04466537ad56 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.569081 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0fdd45d-003a-4c44-a79b-04466537ad56 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.570131 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0fdd45d-003a-4c44-a79b-04466537ad56 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.570878 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0fdd45d-003a-4c44-a79b-04466537ad56 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.571372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d0fdd45d-003a-4c44-a79b-04466537ad56 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.597723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0ee08ea4-0aaa-4ae9-a595-3f9cfd846226 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 204 len: 0 microversion: 2.1 time: 0.448730 Aug 24 10:22:06.602209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 327/656] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:22:06 2022] DELETE /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:22:06.611336 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3ab69ade-b698-4bb5-8bc5-0cdae3e5f4fb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:06.612625 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3ab69ade-b698-4bb5-8bc5-0cdae3e5f4fb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:06.619559 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3ab69ade-b698-4bb5-8bc5-0cdae3e5f4fb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.620374 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3ab69ade-b698-4bb5-8bc5-0cdae3e5f4fb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.620972 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3ab69ade-b698-4bb5-8bc5-0cdae3e5f4fb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.621779 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3ab69ade-b698-4bb5-8bc5-0cdae3e5f4fb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.622355 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3ab69ade-b698-4bb5-8bc5-0cdae3e5f4fb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.623011 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3ab69ade-b698-4bb5-8bc5-0cdae3e5f4fb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.628411 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d0fdd45d-003a-4c44-a79b-04466537ad56 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Going to try to terminate instance {{(pid=121270) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:22:06.832222 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3ab69ade-b698-4bb5-8bc5-0cdae3e5f4fb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:06.839025 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:06.878687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3ab69ade-b698-4bb5-8bc5-0cdae3e5f4fb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.267846 Aug 24 10:22:06.878687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 328/657] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:06 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:06.899109 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:06.902647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:06.921932 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.922913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.925953 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.927105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:06.930361 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:06.933036 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:06.948065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:07.061207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d0fdd45d-003a-4c44-a79b-04466537ad56 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 204 len: 0 microversion: 2.1 time: 0.507004 Aug 24 10:22:07.061829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 330/658] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:22:06 2022] DELETE /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:22:07.070998 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-92d2663a-02ce-40e0-a2af-f6680e9b8a19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:07.071476 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-92d2663a-02ce-40e0-a2af-f6680e9b8a19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:07.078495 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d2663a-02ce-40e0-a2af-f6680e9b8a19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.079056 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d2663a-02ce-40e0-a2af-f6680e9b8a19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.079545 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d2663a-02ce-40e0-a2af-f6680e9b8a19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:07.080265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d2663a-02ce-40e0-a2af-f6680e9b8a19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.080721 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d2663a-02ce-40e0-a2af-f6680e9b8a19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.081184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d2663a-02ce-40e0-a2af-f6680e9b8a19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:07.101004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:07.109996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:07.111527 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:07.113158 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4b66e16a-1810-46fb-83aa-9f04b5b471b1 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.235379 Aug 24 10:22:07.113899 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 329/659] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:06 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:07.218724 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-92d2663a-02ce-40e0-a2af-f6680e9b8a19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:07.226756 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-92d2663a-02ce-40e0-a2af-f6680e9b8a19 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1677 microversion: 2.1 time: 0.160396 Aug 24 10:22:07.227906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 331/660] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:07 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:07.899269 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d566afb8-a648-4eb3-ac49-09d45f1d5bdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:07.899888 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d566afb8-a648-4eb3-ac49-09d45f1d5bdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:07.907933 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d566afb8-a648-4eb3-ac49-09d45f1d5bdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.908420 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d566afb8-a648-4eb3-ac49-09d45f1d5bdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.908872 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d566afb8-a648-4eb3-ac49-09d45f1d5bdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:07.909581 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d566afb8-a648-4eb3-ac49-09d45f1d5bdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:07.910038 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d566afb8-a648-4eb3-ac49-09d45f1d5bdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:07.910465 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d566afb8-a648-4eb3-ac49-09d45f1d5bdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:08.046434 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d566afb8-a648-4eb3-ac49-09d45f1d5bdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:08.056077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d566afb8-a648-4eb3-ac49-09d45f1d5bdb tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.160667 Aug 24 10:22:08.060822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 330/661] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:07 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:08.136394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:08.137032 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:08.144222 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:08.144914 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:08.145343 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:08.146025 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:08.146470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:08.146885 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:08.248991 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9729f976-117f-4eef-844b-e57a550fd19a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:08.249686 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9729f976-117f-4eef-844b-e57a550fd19a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:08.255691 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9729f976-117f-4eef-844b-e57a550fd19a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:08.256177 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9729f976-117f-4eef-844b-e57a550fd19a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:08.256620 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9729f976-117f-4eef-844b-e57a550fd19a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:08.257501 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9729f976-117f-4eef-844b-e57a550fd19a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:08.257991 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9729f976-117f-4eef-844b-e57a550fd19a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:08.258421 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9729f976-117f-4eef-844b-e57a550fd19a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:08.281559 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:08.290620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:08.292429 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:08.293579 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-abc94313-aba1-4b16-b4dd-5b6c52bead79 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.161483 Aug 24 10:22:08.294134 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 332/662] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:08 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:08.399387 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9729f976-117f-4eef-844b-e57a550fd19a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:08.407745 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9729f976-117f-4eef-844b-e57a550fd19a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1677 microversion: 2.1 time: 0.162789 Aug 24 10:22:08.408320 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 331/663] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:08 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:09.077947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7347e7af-4f48-4dc2-9c51-b43542415cff tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:09.078552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7347e7af-4f48-4dc2-9c51-b43542415cff tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:09.084558 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7347e7af-4f48-4dc2-9c51-b43542415cff tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.085064 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7347e7af-4f48-4dc2-9c51-b43542415cff tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.085491 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7347e7af-4f48-4dc2-9c51-b43542415cff tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.086165 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7347e7af-4f48-4dc2-9c51-b43542415cff tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.086608 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7347e7af-4f48-4dc2-9c51-b43542415cff tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.087022 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7347e7af-4f48-4dc2-9c51-b43542415cff tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.222152 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7347e7af-4f48-4dc2-9c51-b43542415cff tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:09.229693 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7347e7af-4f48-4dc2-9c51-b43542415cff tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.155683 Aug 24 10:22:09.230247 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 333/664] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:09 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:09.316364 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:09.317039 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:09.323419 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.323900 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.324337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.325062 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.325514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.325937 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.429878 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-49ce92ed-bffc-4952-b0af-1e25ed4545bb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:09.430422 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-49ce92ed-bffc-4952-b0af-1e25ed4545bb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:09.437196 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ce92ed-bffc-4952-b0af-1e25ed4545bb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.438576 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ce92ed-bffc-4952-b0af-1e25ed4545bb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.438576 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ce92ed-bffc-4952-b0af-1e25ed4545bb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.438905 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ce92ed-bffc-4952-b0af-1e25ed4545bb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:09.439356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ce92ed-bffc-4952-b0af-1e25ed4545bb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:09.439782 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-49ce92ed-bffc-4952-b0af-1e25ed4545bb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:09.459105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:09.467680 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:09.469355 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:09.470808 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1cf89238-3814-4695-aff3-f534b9160419 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.158070 Aug 24 10:22:09.481436 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 332/665] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:09 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:09.570644 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-49ce92ed-bffc-4952-b0af-1e25ed4545bb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:09.578533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-49ce92ed-bffc-4952-b0af-1e25ed4545bb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1677 microversion: 2.1 time: 0.153325 Aug 24 10:22:09.579144 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 334/666] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:09 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:10.251576 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a00cb7b3-02a8-4546-9136-f204a35d5606 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:10.252263 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a00cb7b3-02a8-4546-9136-f204a35d5606 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:10.258735 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a00cb7b3-02a8-4546-9136-f204a35d5606 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.259006 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a00cb7b3-02a8-4546-9136-f204a35d5606 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.259275 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a00cb7b3-02a8-4546-9136-f204a35d5606 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.259974 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a00cb7b3-02a8-4546-9136-f204a35d5606 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.260442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a00cb7b3-02a8-4546-9136-f204a35d5606 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.260883 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a00cb7b3-02a8-4546-9136-f204a35d5606 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.411418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a00cb7b3-02a8-4546-9136-f204a35d5606 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:10.419400 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a00cb7b3-02a8-4546-9136-f204a35d5606 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.171975 Aug 24 10:22:10.419971 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 333/667] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:10 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:10.470544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-f1471270-898b-4ce3-9fea-1f218db29023 req-04bf243f-cd90-4ff5-9e17-1609802fb7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246f3e69-c7bf-462e-88a0-e209d93b5603", "tag": "a92e393c-0dd2-4ec0-8147-c860a2c195f8"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:10.480732 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-f1471270-898b-4ce3-9fea-1f218db29023 req-04bf243f-cd90-4ff5-9e17-1609802fb7e3 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.481234 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-f1471270-898b-4ce3-9fea-1f218db29023 req-04bf243f-cd90-4ff5-9e17-1609802fb7e3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.481662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-f1471270-898b-4ce3-9fea-1f218db29023 req-04bf243f-cd90-4ff5-9e17-1609802fb7e3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.494108 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-f1471270-898b-4ce3-9fea-1f218db29023 req-04bf243f-cd90-4ff5-9e17-1609802fb7e3 service nova] Creating event network-changed:a92e393c-0dd2-4ec0-8147-c860a2c195f8 for instance 246f3e69-c7bf-462e-88a0-e209d93b5603 on hv-cinder-85427 Aug 24 10:22:10.494330 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:10.494920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:10.499895 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-f1471270-898b-4ce3-9fea-1f218db29023 req-04bf243f-cd90-4ff5-9e17-1609802fb7e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033880 Aug 24 10:22:10.505403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 335/668] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:10.506122 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.506122 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.506122 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.506122 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.506568 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.506568 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.600451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-75027170-f32b-4224-a645-b9399d49ea78 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:10.601176 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-75027170-f32b-4224-a645-b9399d49ea78 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:10.608729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75027170-f32b-4224-a645-b9399d49ea78 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.609446 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75027170-f32b-4224-a645-b9399d49ea78 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.609929 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75027170-f32b-4224-a645-b9399d49ea78 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.610629 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75027170-f32b-4224-a645-b9399d49ea78 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:10.611104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75027170-f32b-4224-a645-b9399d49ea78 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:10.611521 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-75027170-f32b-4224-a645-b9399d49ea78 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:10.641040 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:10.649364 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:10.650947 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:10.652151 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e75f4798-2121-4820-bb24-d4bb34332f88 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.162205 Aug 24 10:22:10.652832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 334/669] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:10 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:22:10.749700 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-75027170-f32b-4224-a645-b9399d49ea78 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:10.757822 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-75027170-f32b-4224-a645-b9399d49ea78 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1677 microversion: 2.1 time: 0.162008 Aug 24 10:22:10.758393 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 336/670] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:10 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:11.441988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c83defdf-96a1-4b8c-8b9a-eceab81e8742 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:11.442599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c83defdf-96a1-4b8c-8b9a-eceab81e8742 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:11.449296 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c83defdf-96a1-4b8c-8b9a-eceab81e8742 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.449794 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c83defdf-96a1-4b8c-8b9a-eceab81e8742 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.450266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c83defdf-96a1-4b8c-8b9a-eceab81e8742 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.450952 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c83defdf-96a1-4b8c-8b9a-eceab81e8742 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.451443 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c83defdf-96a1-4b8c-8b9a-eceab81e8742 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.452244 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c83defdf-96a1-4b8c-8b9a-eceab81e8742 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.582862 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c83defdf-96a1-4b8c-8b9a-eceab81e8742 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.589535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c83defdf-96a1-4b8c-8b9a-eceab81e8742 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1523 microversion: 2.1 time: 0.151320 Aug 24 10:22:11.590106 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 335/671] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:11 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:11.675998 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:11.677289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:11.683822 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.684303 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.684739 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.691444 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.691444 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.691444 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.780546 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a3a0b4d6-6b83-4280-9485-82be6bbe9d8c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:11.782287 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a3a0b4d6-6b83-4280-9485-82be6bbe9d8c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:11.790269 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3a0b4d6-6b83-4280-9485-82be6bbe9d8c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.790896 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3a0b4d6-6b83-4280-9485-82be6bbe9d8c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.791466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3a0b4d6-6b83-4280-9485-82be6bbe9d8c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.792678 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3a0b4d6-6b83-4280-9485-82be6bbe9d8c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:11.793231 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3a0b4d6-6b83-4280-9485-82be6bbe9d8c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:11.793760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3a0b4d6-6b83-4280-9485-82be6bbe9d8c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:11.926658 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:11.944019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=6 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:11.974599 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.983382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.986193 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:11.988330 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4e5f5b7c-6cbb-410b-ab5a-f7e053ac168f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.317021 Aug 24 10:22:12.004668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 337/672] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:11 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:12.041349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a3a0b4d6-6b83-4280-9485-82be6bbe9d8c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:12.051466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a3a0b4d6-6b83-4280-9485-82be6bbe9d8c tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1677 microversion: 2.1 time: 0.274699 Aug 24 10:22:12.065321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 336/673] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:11 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1677 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:12.514547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-c5c7e469-67fb-422d-bac0-b2f38753ec01 req-acd05175-830a-4372-9364-c34a51ec4652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634", "name": "network-vif-deleted", "tag": "f28dce31-d9c2-4fa3-a64a-63c9f2a85bd8"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:12.526065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c5c7e469-67fb-422d-bac0-b2f38753ec01 req-acd05175-830a-4372-9364-c34a51ec4652 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.528197 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c5c7e469-67fb-422d-bac0-b2f38753ec01 req-acd05175-830a-4372-9364-c34a51ec4652 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.528197 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c5c7e469-67fb-422d-bac0-b2f38753ec01 req-acd05175-830a-4372-9364-c34a51ec4652 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.538626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-c5c7e469-67fb-422d-bac0-b2f38753ec01 req-acd05175-830a-4372-9364-c34a51ec4652 service nova] Creating event network-vif-deleted:f28dce31-d9c2-4fa3-a64a-63c9f2a85bd8 for instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 on hv-cinder-85427 Aug 24 10:22:12.543541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-c5c7e469-67fb-422d-bac0-b2f38753ec01 req-acd05175-830a-4372-9364-c34a51ec4652 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032681 Aug 24 10:22:12.544142 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 338/674] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:12.613154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d3756940-80b4-465e-bfef-c054ccb8821d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:12.613782 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d3756940-80b4-465e-bfef-c054ccb8821d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:12.616565 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:12.621312 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d3756940-80b4-465e-bfef-c054ccb8821d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.621834 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d3756940-80b4-465e-bfef-c054ccb8821d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.622271 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d3756940-80b4-465e-bfef-c054ccb8821d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.623011 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d3756940-80b4-465e-bfef-c054ccb8821d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:12.623469 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d3756940-80b4-465e-bfef-c054ccb8821d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:12.623914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d3756940-80b4-465e-bfef-c054ccb8821d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:12.695850 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d3756940-80b4-465e-bfef-c054ccb8821d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:12.704314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d3756940-80b4-465e-bfef-c054ccb8821d tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1307 microversion: 2.1 time: 0.096416 Aug 24 10:22:12.705253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 337/675] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:12 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:13.012970 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.013796 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:13.020320 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.020896 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.021482 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.022256 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.022828 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.023348 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.074918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-757a6c19-8846-4784-975e-5684ef331078 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.075687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-757a6c19-8846-4784-975e-5684ef331078 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:13.083243 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-757a6c19-8846-4784-975e-5684ef331078 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.083727 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-757a6c19-8846-4784-975e-5684ef331078 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.084161 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-757a6c19-8846-4784-975e-5684ef331078 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.084875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-757a6c19-8846-4784-975e-5684ef331078 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.085561 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-757a6c19-8846-4784-975e-5684ef331078 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.085993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-757a6c19-8846-4784-975e-5684ef331078 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.155013 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-757a6c19-8846-4784-975e-5684ef331078 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.168192 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-757a6c19-8846-4784-975e-5684ef331078 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1610 microversion: 2.1 time: 0.097722 Aug 24 10:22:13.168960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 338/676] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1610 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:13.265063 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-792e0e68-ea2e-49c8-960e-0f43f83a4ba3 req-376c313f-4cfa-45ed-8760-ea2038d91487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1", "name": "network-vif-deleted", "tag": "a0b112d7-221f-4e33-a257-82953d4549d7"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:13.265214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.277009 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.278999 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.280508 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c5f3f4f6-3658-4cc0-98c0-28bffa86e97c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.272599 Aug 24 10:22:13.282473 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 339/677] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:13.303029 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=8 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:13.306428 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-792e0e68-ea2e-49c8-960e-0f43f83a4ba3 req-376c313f-4cfa-45ed-8760-ea2038d91487 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.306912 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-792e0e68-ea2e-49c8-960e-0f43f83a4ba3 req-376c313f-4cfa-45ed-8760-ea2038d91487 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.307346 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-792e0e68-ea2e-49c8-960e-0f43f83a4ba3 req-376c313f-4cfa-45ed-8760-ea2038d91487 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.319688 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-792e0e68-ea2e-49c8-960e-0f43f83a4ba3 req-376c313f-4cfa-45ed-8760-ea2038d91487 service nova] Creating event network-vif-deleted:a0b112d7-221f-4e33-a257-82953d4549d7 for instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 on hv-cinder-85427 Aug 24 10:22:13.324799 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-792e0e68-ea2e-49c8-960e-0f43f83a4ba3 req-376c313f-4cfa-45ed-8760-ea2038d91487 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066417 Aug 24 10:22:13.325630 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 339/678] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:13.726662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:13.727306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:13.733329 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.734485 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.734947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.735654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.736108 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.736532 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.768135 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:13.768619 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:13.769095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:13.769540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lazy-loading 'fault' on Instance uuid 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:22:13.772320 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:13.814357 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388174c87a2245ca89a634f3b177e166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a7713fb6804b4db1fbd15fa71afa74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:13.822443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1f627618-0f14-4893-adff-b9dc603426e3 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 200 len: 1312 microversion: 2.1 time: 0.099654 Aug 24 10:22:13.823023 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 340/679] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:13 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:14.190857 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a3db2d4c-a87b-449a-a9ad-e5521472fa31 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:14.191600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a3db2d4c-a87b-449a-a9ad-e5521472fa31 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:14.199983 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3db2d4c-a87b-449a-a9ad-e5521472fa31 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.200701 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3db2d4c-a87b-449a-a9ad-e5521472fa31 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.201166 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3db2d4c-a87b-449a-a9ad-e5521472fa31 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.202653 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3db2d4c-a87b-449a-a9ad-e5521472fa31 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.203545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3db2d4c-a87b-449a-a9ad-e5521472fa31 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.205051 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a3db2d4c-a87b-449a-a9ad-e5521472fa31 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.271997 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a3db2d4c-a87b-449a-a9ad-e5521472fa31 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:14.281258 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a3db2d4c-a87b-449a-a9ad-e5521472fa31 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 200 len: 1322 microversion: 2.1 time: 0.095336 Aug 24 10:22:14.281831 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 340/680] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 1322 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:14.305249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:14.305853 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:14.312806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.313353 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.314390 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.315213 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.315594 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.316017 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.452179 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:14.460306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:14.461823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:14.462926 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8fbabb14-d532-43dd-9056-6028a104a5f3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.162096 Aug 24 10:22:14.463519 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 341/681] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:14.843817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:14.844356 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] [instance: 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:14.851401 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.851885 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.852319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.853057 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:14.853521 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:14.853948 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:14.870016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] HTTP exception thrown: Instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 could not be found. Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Request method failure captured: Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 HTTP/1.1 Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfqeZL8TowYsedOYEynKAPOP9RwdHJIc2D-gELfWWCOmFE4l4co3BDidi-uSQEN7L1Eopi2D_J-scSLzQMafxChW6tVTjZzwAINMHAMdJkgGIX9f6AYn2sKPGG8VZdURC1cZvC1knKHb2lC5R8pG-zv0XHn6P3W5Q3vftEcgy2ZHOSU Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 66a7713fb6804b4db1fbd15fa71afa74 Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:22:14.871687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66a7713fb6804b4db1fbd15fa71afa74", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66a7713fb6804b4db1fbd15fa71afa74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 66a7713fb6804b4db1fbd15fa71afa74 Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-314780275 Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-ServerRescueNegativeTestJSON-314780275-project Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 388174c87a2245ca89a634f3b177e166 Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-ServerRescueNegativeTestJSON-314780275-project Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 could not be found. Aug 24 10:22:14.882362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634'} Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 could not be found. Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:14.883327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 could not be found. Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 could not be found. Aug 24 10:22:14.884704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:14.885998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] Returning 404 to user: Instance 9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:14.885998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-54277147-297b-4f1d-9378-088d891417c5 tempest-ServerRescueNegativeTestJSON-314780275 tempest-ServerRescueNegativeTestJSON-314780275-project] 10.222.0.30 "GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634" status: 404 len: 111 microversion: 2.1 time: 0.033334 Aug 24 10:22:14.885998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 341/682] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:14 2022] GET /compute/v2.1/servers/9f2006ea-56e5-4e8a-ae3b-9ce5b5d4b634 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:15.303490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:15.304196 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:15.310772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:15.311361 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:15.311681 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:15.313305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:15.313305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:15.314060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:15.329143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 HTTP/1.1 Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:22:15.331597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:22:15.333325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': 'cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1'} Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:15.334106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:22:15.335416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:15.336726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:15.336726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9077d2d7-6d7b-47b1-a6c0-54281cb0fe50 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 404 len: 111 microversion: 2.1 time: 0.033529 Aug 24 10:22:15.336726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 342/683] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:15 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:15.342113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-aee2577e-8bc9-4d6e-967b-128aecc63064 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '.version_select at 0x7f0af406e430>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:15.410190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-aee2577e-8bc9-4d6e-967b-128aecc63064 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-899402285" status: 202 len: 0 microversion: 2.1 time: 0.071839 Aug 24 10:22:15.410871 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 342/684] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Aug 24 10:22:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-899402285 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:22:15.486489 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:15.487694 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:15.493491 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:15.493973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:15.499290 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:15.499290 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:15.499290 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:15.499290 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:15.651301 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:15.661671 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:15.667331 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:15.667331 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ccf11f2a-8062-470c-a584-4ed20ffd3477 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.182287 Aug 24 10:22:15.667331 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 343/685] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:15 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:16.301384 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2a897606-8018-475d-9aa2-ea26193cc277 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: .version_select at 0x7f0af407a040>, body: {"keypair": {"name": "tempest-keypair-784523870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALO0WX/sX8ffR36MENpDasWqi+pDyGWQbz+bblC9TIHF8ztFa8tLst6O8tcZYJfIe2RVI5r75n/PZcmtv5JTjKLUnd7HKOW4tWfUWJh6hxN/oozG12Z9o8f+j2x6jK2UQ=="}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:16.322089 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-2a897606-8018-475d-9aa2-ea26193cc277 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for project 8824664cdd104c308141264985a547a1. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:16.327068 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-2a897606-8018-475d-9aa2-ea26193cc277 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for user c94c65ae14e94796a3b3bd0bb29a91b9 and project 8824664cdd104c308141264985a547a1. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:16.434438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2a897606-8018-475d-9aa2-ea26193cc277 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134967 Aug 24 10:22:16.434438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 343/686] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Aug 24 10:22:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:16.689763 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:16.690377 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:16.697020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:16.697597 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:16.698125 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:16.698885 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:16.699339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:16.699755 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:16.862014 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:16.872413 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:16.878846 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:16.878846 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-60e664c4-62fb-4801-b975-68e2c5ad8e1f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.193561 Aug 24 10:22:16.880304 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 344/687] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:16 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:17.833988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-6427def3-b5e9-453f-937e-48ac9d43d459 req-d538df98-4474-43c1-a3d2-9acec639076f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246f3e69-c7bf-462e-88a0-e209d93b5603", "name": "network-vif-plugged", "status": "completed", "tag": "a92e393c-0dd2-4ec0-8147-c860a2c195f8"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:17.843903 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-6427def3-b5e9-453f-937e-48ac9d43d459 req-d538df98-4474-43c1-a3d2-9acec639076f service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:17.844375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-6427def3-b5e9-453f-937e-48ac9d43d459 req-d538df98-4474-43c1-a3d2-9acec639076f service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:17.845362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-6427def3-b5e9-453f-937e-48ac9d43d459 req-d538df98-4474-43c1-a3d2-9acec639076f service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:17.856981 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-6427def3-b5e9-453f-937e-48ac9d43d459 req-d538df98-4474-43c1-a3d2-9acec639076f service nova] Creating event network-vif-plugged:a92e393c-0dd2-4ec0-8147-c860a2c195f8 for instance 246f3e69-c7bf-462e-88a0-e209d93b5603 on hv-cinder-85427 Aug 24 10:22:17.863640 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-6427def3-b5e9-453f-937e-48ac9d43d459 req-d538df98-4474-43c1-a3d2-9acec639076f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039005 Aug 24 10:22:17.868092 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 344/688] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:17.908090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:17.908787 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:17.915936 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:17.916429 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:17.919920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:17.919920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:17.919920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:17.919920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:18.210768 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:18.219783 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:18.221701 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:18.223285 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ad71db20-99f4-465a-a190-1ebd299b2758 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.319556 Aug 24 10:22:18.224756 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 345/689] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:17 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:19.247330 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:19.248017 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:19.254300 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:19.254770 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:19.255198 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:19.255874 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:19.256316 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:19.256729 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:19.375769 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1777622291", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd93ff68-1984-453a-90ae-b4e36ac7c98e"}], "security_groups": [{"name": "tempest-securitygroup--1254623339"}], "key_name": "tempest-keypair-784523870", "user_data": "}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:19.425306 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:19.439017 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:19.441708 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:19.443772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-630de71a-4fe2-409c-93d3-7f762a0c061c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1407 microversion: 2.20 time: 0.200274 Aug 24 10:22:19.444345 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 345/690] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:19 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:19.496960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] validate_networks() for [('cd93ff68-1984-453a-90ae-b4e36ac7c98e', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:22:20.008478 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:22:20.009006 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:22:20.009573 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:22:20.010054 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:22:20.010567 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:22:20.021781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.022351 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.022826 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.023805 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.024384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.025039 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.051410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for project 8824664cdd104c308141264985a547a1. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:22:20.058554 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Getting quotas for user c94c65ae14e94796a3b3bd0bb29a91b9 and project 8824664cdd104c308141264985a547a1. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:22:20.084381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:22:20.086635 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:22:20.224677 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2b8c175f-bdd0-42b8-a7c9-b9f365309544 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.853153 Aug 24 10:22:20.225653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 346/691] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:22:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:22:20.237254 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c0b392ad-a15e-4661-805c-6c57b095c8c4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:20.237888 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c0b392ad-a15e-4661-805c-6c57b095c8c4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:20.310967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c0b392ad-a15e-4661-805c-6c57b095c8c4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:20.319232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c0b392ad-a15e-4661-805c-6c57b095c8c4 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1241 microversion: 2.1 time: 0.086623 Aug 24 10:22:20.322080 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 346/692] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:20 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:20.468765 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:20.469513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:20.477487 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.478632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.479160 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.479931 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.480600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.481124 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.628284 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:20.636437 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:20.637976 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:20.639135 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e3e34770-ca6d-4a14-9865-800667e10a12 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1599 microversion: 2.20 time: 0.175092 Aug 24 10:22:20.639692 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 347/693] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:22:20 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:22:20.662168 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-5385c436-1075-4ae2-af39-78df9085b2a2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:20.662683 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-5385c436-1075-4ae2-af39-78df9085b2a2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:20.668514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5385c436-1075-4ae2-af39-78df9085b2a2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.669049 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5385c436-1075-4ae2-af39-78df9085b2a2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.669461 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5385c436-1075-4ae2-af39-78df9085b2a2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.670148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5385c436-1075-4ae2-af39-78df9085b2a2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:20.671275 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5385c436-1075-4ae2-af39-78df9085b2a2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:20.671275 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5385c436-1075-4ae2-af39-78df9085b2a2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:20.755301 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-5385c436-1075-4ae2-af39-78df9085b2a2 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097030 Aug 24 10:22:20.755899 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 347/694] 10.222.0.30 () {60 vars in 1316 bytes} [Wed Aug 24 10:22:20 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:22:21.169099 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f9c59870-0512-4d49-a28e-464d06e1cf5c tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Action: 'create', calling method: .version_select at 0x7f0af412a790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-50553514"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:21.347157 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f01efd0c-db8f-494d-b496-d9488d2faae2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:21.348805 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f01efd0c-db8f-494d-b496-d9488d2faae2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:21.452994 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f01efd0c-db8f-494d-b496-d9488d2faae2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:21.460367 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f01efd0c-db8f-494d-b496-d9488d2faae2 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1241 microversion: 2.1 time: 0.118060 Aug 24 10:22:21.461163 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 348/695] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:21 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:22:21.921632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f9c59870-0512-4d49-a28e-464d06e1cf5c tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.885889 Aug 24 10:22:21.939043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 348/696] 10.222.0.30 () {60 vars in 1155 bytes} [Wed Aug 24 10:22:21 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 887 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 10:22:21.939198 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-229c3906-e39f-4515-a2ed-c2fa43e30dbe tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af4062af0>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:21.989824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-229c3906-e39f-4515-a2ed-c2fa43e30dbe tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc" status: 200 len: 343 microversion: 2.1 time: 0.054996 Aug 24 10:22:21.989824 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 349/697] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:22:21 2022] GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc => generated 343 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:22.092987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-d59208b5-510d-43d7-b2f2-cc78705e7a52 req-2ce60b0a-5e9e-49f5-b4f2-f0251b3bfae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246f3e69-c7bf-462e-88a0-e209d93b5603", "tag": "a92e393c-0dd2-4ec0-8147-c860a2c195f8"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:22.103145 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-d59208b5-510d-43d7-b2f2-cc78705e7a52 req-2ce60b0a-5e9e-49f5-b4f2-f0251b3bfae3 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.103863 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-d59208b5-510d-43d7-b2f2-cc78705e7a52 req-2ce60b0a-5e9e-49f5-b4f2-f0251b3bfae3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.104284 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-d59208b5-510d-43d7-b2f2-cc78705e7a52 req-2ce60b0a-5e9e-49f5-b4f2-f0251b3bfae3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.115785 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-d59208b5-510d-43d7-b2f2-cc78705e7a52 req-2ce60b0a-5e9e-49f5-b4f2-f0251b3bfae3 service nova] Creating event network-changed:a92e393c-0dd2-4ec0-8147-c860a2c195f8 for instance 246f3e69-c7bf-462e-88a0-e209d93b5603 on hv-cinder-85427 Aug 24 10:22:22.124662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-d59208b5-510d-43d7-b2f2-cc78705e7a52 req-2ce60b0a-5e9e-49f5-b4f2-f0251b3bfae3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032036 Aug 24 10:22:22.124662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 349/698] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:22.482184 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c395ad95-b6f5-44fb-a408-b6c5f4e5d8fd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:22.482931 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c395ad95-b6f5-44fb-a408-b6c5f4e5d8fd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:22.492410 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c395ad95-b6f5-44fb-a408-b6c5f4e5d8fd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.493027 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c395ad95-b6f5-44fb-a408-b6c5f4e5d8fd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.493736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c395ad95-b6f5-44fb-a408-b6c5f4e5d8fd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.494515 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c395ad95-b6f5-44fb-a408-b6c5f4e5d8fd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:22.494964 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c395ad95-b6f5-44fb-a408-b6c5f4e5d8fd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:22.495587 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c395ad95-b6f5-44fb-a408-b6c5f4e5d8fd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:22.562465 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c395ad95-b6f5-44fb-a408-b6c5f4e5d8fd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:22.571169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c395ad95-b6f5-44fb-a408-b6c5f4e5d8fd tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1293 microversion: 2.1 time: 0.093647 Aug 24 10:22:22.575989 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 350/699] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:22 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:23.006488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-06732783-813a-4f70-92ae-5da45b34e582 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af412ac10>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:23.061753 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-06732783-813a-4f70-92ae-5da45b34e582 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc" status: 200 len: 344 microversion: 2.1 time: 0.063578 Aug 24 10:22:23.062765 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 350/700] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:22:22 2022] GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:23.078079 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1da3cafc-c609-4028-9bc0-6c65eab54c57 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Action: 'create', calling method: .version_select at 0x7f0af420b940>, body: {"snapshot": {"volume_id": "887cec0c-7264-4366-8851-e2155058eccc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1251296407"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:23.586106 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1da3cafc-c609-4028-9bc0-6c65eab54c57 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.513204 Aug 24 10:22:23.586943 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 351/701] 10.222.0.30 () {60 vars in 1162 bytes} [Wed Aug 24 10:22:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:23.597619 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-155d8aae-9bbd-432b-b8bf-f7f57cf105c1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:23.598553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-155d8aae-9bbd-432b-b8bf-f7f57cf105c1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:23.599699 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-76f56346-1f28-4095-be4c-0bfd95c3c31f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af40c1940>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:23.605960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-155d8aae-9bbd-432b-b8bf-f7f57cf105c1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:23.606455 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-155d8aae-9bbd-432b-b8bf-f7f57cf105c1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:23.606889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-155d8aae-9bbd-432b-b8bf-f7f57cf105c1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:23.607589 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-155d8aae-9bbd-432b-b8bf-f7f57cf105c1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:23.608041 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-155d8aae-9bbd-432b-b8bf-f7f57cf105c1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:23.608811 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-155d8aae-9bbd-432b-b8bf-f7f57cf105c1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:23.635964 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-76f56346-1f28-4095-be4c-0bfd95c3c31f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970" status: 200 len: 287 microversion: 2.1 time: 0.042596 Aug 24 10:22:23.636907 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 352/702] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Aug 24 10:22:23 2022] GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:23.649151 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b55981f6-7f12-43d5-80d1-626ca794ffe8 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af407a310>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:23.681670 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b55981f6-7f12-43d5-80d1-626ca794ffe8 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036522 Aug 24 10:22:23.687836 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 353/703] 10.222.0.30 () {58 vars in 1140 bytes} [Wed Aug 24 10:22:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:23.688973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-155d8aae-9bbd-432b-b8bf-f7f57cf105c1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:23.694240 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-768429ba-8a09-479b-a84f-07ac98aa2c73 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af4036ca0>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:23.701105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-155d8aae-9bbd-432b-b8bf-f7f57cf105c1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1299 microversion: 2.1 time: 0.107177 Aug 24 10:22:23.701783 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 351/704] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:23 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:23.726818 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-768429ba-8a09-479b-a84f-07ac98aa2c73 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970" status: 200 len: 287 microversion: 2.1 time: 0.036227 Aug 24 10:22:23.727645 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 354/705] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Aug 24 10:22:23 2022] GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:24.726967 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b6076b2c-f849-4fa0-8fd3-27a5c05a8724 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:24.727576 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b6076b2c-f849-4fa0-8fd3-27a5c05a8724 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:24.734134 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b6076b2c-f849-4fa0-8fd3-27a5c05a8724 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:24.734610 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b6076b2c-f849-4fa0-8fd3-27a5c05a8724 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:24.735047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b6076b2c-f849-4fa0-8fd3-27a5c05a8724 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:24.735776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b6076b2c-f849-4fa0-8fd3-27a5c05a8724 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:24.736220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b6076b2c-f849-4fa0-8fd3-27a5c05a8724 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:24.736637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b6076b2c-f849-4fa0-8fd3-27a5c05a8724 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:24.739631 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4a462bff-b287-4901-b99f-5a1cb615d5e2 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af407a3a0>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:24.768939 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4a462bff-b287-4901-b99f-5a1cb615d5e2 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970" status: 200 len: 287 microversion: 2.1 time: 0.034088 Aug 24 10:22:24.769521 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 355/706] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Aug 24 10:22:24 2022] GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:24.873180 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b6076b2c-f849-4fa0-8fd3-27a5c05a8724 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:24.881226 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b6076b2c-f849-4fa0-8fd3-27a5c05a8724 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1367 microversion: 2.1 time: 0.158067 Aug 24 10:22:24.881791 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 352/707] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:24 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:25.781151 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ca7ea10b-d823-4437-885e-63fff0d12702 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af406e670>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:25.812081 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ca7ea10b-d823-4437-885e-63fff0d12702 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970" status: 200 len: 287 microversion: 2.1 time: 0.035136 Aug 24 10:22:25.812635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 356/708] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Aug 24 10:22:25 2022] GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:25.901973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-52c0c672-122f-421c-b079-d09a1254a3b7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:25.902578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-52c0c672-122f-421c-b079-d09a1254a3b7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:25.909727 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-52c0c672-122f-421c-b079-d09a1254a3b7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:25.910206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-52c0c672-122f-421c-b079-d09a1254a3b7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:25.910642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-52c0c672-122f-421c-b079-d09a1254a3b7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:25.911340 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-52c0c672-122f-421c-b079-d09a1254a3b7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:25.911801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-52c0c672-122f-421c-b079-d09a1254a3b7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:25.912225 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-52c0c672-122f-421c-b079-d09a1254a3b7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:26.043229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-52c0c672-122f-421c-b079-d09a1254a3b7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:26.051636 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-52c0c672-122f-421c-b079-d09a1254a3b7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1367 microversion: 2.1 time: 0.153488 Aug 24 10:22:26.052203 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 353/709] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:25 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:26.825337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-49ecfd2f-0428-43b2-9d7f-2bb748122d96 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af40cfc10>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:26.857590 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-49ecfd2f-0428-43b2-9d7f-2bb748122d96 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970" status: 200 len: 287 microversion: 2.1 time: 0.035159 Aug 24 10:22:26.857590 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 357/710] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Aug 24 10:22:26 2022] GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:27.071951 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bc12c28b-4eb5-4f6d-834e-093546757487 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:27.072566 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bc12c28b-4eb5-4f6d-834e-093546757487 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:27.078985 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc12c28b-4eb5-4f6d-834e-093546757487 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:27.079477 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc12c28b-4eb5-4f6d-834e-093546757487 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:27.079908 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc12c28b-4eb5-4f6d-834e-093546757487 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:27.080601 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc12c28b-4eb5-4f6d-834e-093546757487 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:27.081090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc12c28b-4eb5-4f6d-834e-093546757487 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:27.081518 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc12c28b-4eb5-4f6d-834e-093546757487 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:27.282859 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bc12c28b-4eb5-4f6d-834e-093546757487 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:27.290613 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bc12c28b-4eb5-4f6d-834e-093546757487 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1367 microversion: 2.1 time: 0.222487 Aug 24 10:22:27.291540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 354/711] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:27 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:27.433543 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-12b69f1a-6bc3-4590-bd05-119e0dbfa2f7 req-671329bc-32f6-4e84-99e1-3c7be2f00a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f768af80-7eb3-49d3-b572-5665427c78ef", "tag": "d1dc3025-0942-4668-8591-d4a8783a2107"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:27.443670 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-12b69f1a-6bc3-4590-bd05-119e0dbfa2f7 req-671329bc-32f6-4e84-99e1-3c7be2f00a93 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:27.444133 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-12b69f1a-6bc3-4590-bd05-119e0dbfa2f7 req-671329bc-32f6-4e84-99e1-3c7be2f00a93 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:27.444567 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-12b69f1a-6bc3-4590-bd05-119e0dbfa2f7 req-671329bc-32f6-4e84-99e1-3c7be2f00a93 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:27.454784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-12b69f1a-6bc3-4590-bd05-119e0dbfa2f7 req-671329bc-32f6-4e84-99e1-3c7be2f00a93 service nova] Creating event network-changed:d1dc3025-0942-4668-8591-d4a8783a2107 for instance f768af80-7eb3-49d3-b572-5665427c78ef on hv-cinder-85427 Aug 24 10:22:27.459320 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-12b69f1a-6bc3-4590-bd05-119e0dbfa2f7 req-671329bc-32f6-4e84-99e1-3c7be2f00a93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090656 Aug 24 10:22:27.459904 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 358/712] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:27.868963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-422529a6-de11-4ecc-8261-0a3a035d9e65 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af4160280>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:27.902512 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-422529a6-de11-4ecc-8261-0a3a035d9e65 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970" status: 200 len: 288 microversion: 2.1 time: 0.035009 Aug 24 10:22:27.902512 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 355/713] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Aug 24 10:22:27 2022] GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:27.913754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-75af71f7-a78a-402b-ab8d-f77ee5c708c3 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af4036940>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:28.112752 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-75af71f7-a78a-402b-ab8d-f77ee5c708c3 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970" status: 202 len: 0 microversion: 2.1 time: 0.204006 Aug 24 10:22:28.113377 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 359/714] 10.222.0.30 () {58 vars in 1254 bytes} [Wed Aug 24 10:22:27 2022] DELETE /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:22:28.122073 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-01f94840-621f-4f6a-944f-44fde6dbb2a1 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af4110670>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:28.151732 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-01f94840-621f-4f6a-944f-44fde6dbb2a1 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970" status: 200 len: 287 microversion: 2.1 time: 0.033919 Aug 24 10:22:28.152297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 356/715] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Aug 24 10:22:28 2022] GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:28.315758 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9b5b6f85-d521-42a1-9137-3ff5c2055856 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:28.316691 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9b5b6f85-d521-42a1-9137-3ff5c2055856 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:28.323270 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f85-d521-42a1-9137-3ff5c2055856 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:28.323747 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f85-d521-42a1-9137-3ff5c2055856 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:28.324203 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f85-d521-42a1-9137-3ff5c2055856 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:28.324917 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f85-d521-42a1-9137-3ff5c2055856 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:28.325364 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f85-d521-42a1-9137-3ff5c2055856 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:28.325785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9b5b6f85-d521-42a1-9137-3ff5c2055856 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:28.459233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9b5b6f85-d521-42a1-9137-3ff5c2055856 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:28.467283 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9b5b6f85-d521-42a1-9137-3ff5c2055856 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1367 microversion: 2.1 time: 0.156467 Aug 24 10:22:28.467711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 360/716] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:28 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:29.164478 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2e9b064d-87e9-48e5-986f-93c2aac81210 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af40ab280>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:29.189409 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-2e9b064d-87e9-48e5-986f-93c2aac81210 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] HTTP exception thrown: Snapshot f5c0b0fb-30e1-466d-9148-7b38e51e0970 could not be found. Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2e9b064d-87e9-48e5-986f-93c2aac81210 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Request method failure captured: Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970 HTTP/1.1 Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfvciqkfu7grg64jimYhlgvGSABp9sqTYJxtMBNB10XvLQ7N8D1ZFh0XN38UuEfp6ZznYT0O0NAO4e9I5nWP7ZXi7BFOjnT3b7TgztRj5kIanv4wn1UVyABm-bz9xTogEJZsJjDEvvj8WP5icYsJPSP_ahZDQ1TqzZ-Ue-uI5wUikrY Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 0dc25f4988ee446686b0e12a0b54892a Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:22:29.192935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0dc25f4988ee446686b0e12a0b54892a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 0dc25f4988ee446686b0e12a0b54892a Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-VolumesSnapshotsTestJSON-783729214-project Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: ea449a6088aa490f879f2de802de134d Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-VolumesSnapshotsTestJSON-783729214-project Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Snapshot f5c0b0fb-30e1-466d-9148-7b38e51e0970 could not be found. Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': 'f5c0b0fb-30e1-466d-9148-7b38e51e0970'} Aug 24 10:22:29.194490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f5c0b0fb-30e1-466d-9148-7b38e51e0970 could not be found. (HTTP 404) (Request-ID: req-08f04df2-c191-4d68-8c05-da87b9e07efd) Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.195879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:22:29.197380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f5c0b0fb-30e1-466d-9148-7b38e51e0970 could not be found. Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 10:22:29.198750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f5c0b0fb-30e1-466d-9148-7b38e51e0970 could not be found. Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f5c0b0fb-30e1-466d-9148-7b38e51e0970 could not be found. Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2e9b064d-87e9-48e5-986f-93c2aac81210 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Returning 404 to user: Snapshot f5c0b0fb-30e1-466d-9148-7b38e51e0970 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2e9b064d-87e9-48e5-986f-93c2aac81210 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970" status: 404 len: 111 microversion: 2.1 time: 0.034052 Aug 24 10:22:29.200159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 357/717] 10.222.0.30 () {58 vars in 1251 bytes} [Wed Aug 24 10:22:29 2022] GET /compute/v2.1/os-snapshots/f5c0b0fb-30e1-466d-9148-7b38e51e0970 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:29.203395 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-02f33ee1-7f69-4457-83aa-24065a31c97d tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af4036af0>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:29.374318 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-02f33ee1-7f69-4457-83aa-24065a31c97d tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc" status: 202 len: 0 microversion: 2.1 time: 0.174584 Aug 24 10:22:29.377960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 361/718] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Aug 24 10:22:29 2022] DELETE /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:22:29.383480 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b423125b-1dd1-48d3-9f75-476b8c16aa70 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af40eb310>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:29.432570 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b423125b-1dd1-48d3-9f75-476b8c16aa70 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc" status: 200 len: 343 microversion: 2.1 time: 0.052970 Aug 24 10:22:29.433168 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 358/719] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:22:29 2022] GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc => generated 343 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:29.488379 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e94eec38-bfef-4201-b63e-761da02e6eac tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:29.489010 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e94eec38-bfef-4201-b63e-761da02e6eac tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:29.495152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e94eec38-bfef-4201-b63e-761da02e6eac tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.495633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e94eec38-bfef-4201-b63e-761da02e6eac tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.496070 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e94eec38-bfef-4201-b63e-761da02e6eac tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.496760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e94eec38-bfef-4201-b63e-761da02e6eac tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:29.497268 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e94eec38-bfef-4201-b63e-761da02e6eac tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:29.497696 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e94eec38-bfef-4201-b63e-761da02e6eac tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:29.517464 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=100 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:29.632372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e94eec38-bfef-4201-b63e-761da02e6eac tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:29.639929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e94eec38-bfef-4201-b63e-761da02e6eac tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1367 microversion: 2.1 time: 0.156295 Aug 24 10:22:29.640522 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 362/720] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:29 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:30.443993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:30.444909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=6 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:30.449216 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-72de6698-ebde-4a8c-8182-a8165c497c67 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af40abd30>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:30.477794 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-72de6698-ebde-4a8c-8182-a8165c497c67 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] HTTP exception thrown: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-72de6698-ebde-4a8c-8182-a8165c497c67 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Request method failure captured: Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc HTTP/1.1 Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfvciqkfu7grg64jimYhlgvGSABp9sqTYJxtMBNB10XvLQ7N8D1ZFh0XN38UuEfp6ZznYT0O0NAO4e9I5nWP7ZXi7BFOjnT3b7TgztRj5kIanv4wn1UVyABm-bz9xTogEJZsJjDEvvj8WP5icYsJPSP_ahZDQ1TqzZ-Ue-uI5wUikrY Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 0dc25f4988ee446686b0e12a0b54892a Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:22:30.480047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0dc25f4988ee446686b0e12a0b54892a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 0dc25f4988ee446686b0e12a0b54892a Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-VolumesSnapshotsTestJSON-783729214-project Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: ea449a6088aa490f879f2de802de134d Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-VolumesSnapshotsTestJSON-783729214-project Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '887cec0c-7264-4366-8851-e2155058eccc'} Aug 24 10:22:30.485678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. (HTTP 404) (Request-ID: req-c7ad8d3d-3692-479d-abe8-92c61602576b) Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.486620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:22:30.488061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 10:22:30.489162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-72de6698-ebde-4a8c-8182-a8165c497c67 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Returning 404 to user: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-72de6698-ebde-4a8c-8182-a8165c497c67 tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc" status: 404 len: 109 microversion: 2.1 time: 0.038333 Aug 24 10:22:30.490298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 359/721] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:22:30 2022] GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:30.496723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3d0b61ae-8fc3-48a5-9ca0-62e5a9fb6b3f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af4036040>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:30.526934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-3d0b61ae-8fc3-48a5-9ca0-62e5a9fb6b3f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] HTTP exception thrown: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3d0b61ae-8fc3-48a5-9ca0-62e5a9fb6b3f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Request method failure captured: Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: DELETE /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc HTTP/1.1 Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfvciqkfu7grg64jimYhlgvGSABp9sqTYJxtMBNB10XvLQ7N8D1ZFh0XN38UuEfp6ZznYT0O0NAO4e9I5nWP7ZXi7BFOjnT3b7TgztRj5kIanv4wn1UVyABm-bz9xTogEJZsJjDEvvj8WP5icYsJPSP_ahZDQ1TqzZ-Ue-uI5wUikrY Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 0dc25f4988ee446686b0e12a0b54892a Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:22:30.529053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0dc25f4988ee446686b0e12a0b54892a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 0dc25f4988ee446686b0e12a0b54892a Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-VolumesSnapshotsTestJSON-783729214-project Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: ea449a6088aa490f879f2de802de134d Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-VolumesSnapshotsTestJSON-783729214-project Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '887cec0c-7264-4366-8851-e2155058eccc'} Aug 24 10:22:30.530574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. (HTTP 404) (Request-ID: req-79868ecb-0a72-46af-b650-1321d3ade82c) Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.531440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:22:30.532668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 10:22:30.534152 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3d0b61ae-8fc3-48a5-9ca0-62e5a9fb6b3f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Returning 404 to user: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3d0b61ae-8fc3-48a5-9ca0-62e5a9fb6b3f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc" status: 404 len: 109 microversion: 2.1 time: 0.037608 Aug 24 10:22:30.535460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 363/722] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Aug 24 10:22:30 2022] DELETE /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:30.540624 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8b77f969-b9be-471a-be10-41387c70738f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Calling method '.version_select at 0x7f0af40eb160>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:30.568069 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-8b77f969-b9be-471a-be10-41387c70738f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] HTTP exception thrown: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8b77f969-b9be-471a-be10-41387c70738f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Request method failure captured: Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc HTTP/1.1 Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfvciqkfu7grg64jimYhlgvGSABp9sqTYJxtMBNB10XvLQ7N8D1ZFh0XN38UuEfp6ZznYT0O0NAO4e9I5nWP7ZXi7BFOjnT3b7TgztRj5kIanv4wn1UVyABm-bz9xTogEJZsJjDEvvj8WP5icYsJPSP_ahZDQ1TqzZ-Ue-uI5wUikrY Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 0dc25f4988ee446686b0e12a0b54892a Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:22:30.570133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0dc25f4988ee446686b0e12a0b54892a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0dc25f4988ee446686b0e12a0b54892a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 0dc25f4988ee446686b0e12a0b54892a Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-783729214 Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-VolumesSnapshotsTestJSON-783729214-project Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: ea449a6088aa490f879f2de802de134d Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-VolumesSnapshotsTestJSON-783729214-project Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '887cec0c-7264-4366-8851-e2155058eccc'} Aug 24 10:22:30.571621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. (HTTP 404) (Request-ID: req-4014acb0-ac9d-4935-8317-e71c78b88ea8) Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.572910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:22:30.574270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 10:22:30.575686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8b77f969-b9be-471a-be10-41387c70738f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] Returning 404 to user: Volume 887cec0c-7264-4366-8851-e2155058eccc could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8b77f969-b9be-471a-be10-41387c70738f tempest-VolumesSnapshotsTestJSON-783729214 tempest-VolumesSnapshotsTestJSON-783729214-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc" status: 404 len: 109 microversion: 2.1 time: 0.035393 Aug 24 10:22:30.577283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 360/723] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:22:30 2022] GET /compute/v2.1/os-volumes/887cec0c-7264-4366-8851-e2155058eccc => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:22:30.661264 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-18d1d3a5-1b03-4e1d-a86f-38a87f3c2918 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:30.662622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-18d1d3a5-1b03-4e1d-a86f-38a87f3c2918 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:30.668498 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18d1d3a5-1b03-4e1d-a86f-38a87f3c2918 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.669017 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18d1d3a5-1b03-4e1d-a86f-38a87f3c2918 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.669458 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18d1d3a5-1b03-4e1d-a86f-38a87f3c2918 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.670162 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18d1d3a5-1b03-4e1d-a86f-38a87f3c2918 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:30.670626 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18d1d3a5-1b03-4e1d-a86f-38a87f3c2918 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:30.671053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18d1d3a5-1b03-4e1d-a86f-38a87f3c2918 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:30.803408 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-18d1d3a5-1b03-4e1d-a86f-38a87f3c2918 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:30.811229 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-18d1d3a5-1b03-4e1d-a86f-38a87f3c2918 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1367 microversion: 2.1 time: 0.153953 Aug 24 10:22:30.811788 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 364/724] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:30 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:31.835273 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c10141ff-5371-4f46-b513-54d39d07e3b3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:31.835855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c10141ff-5371-4f46-b513-54d39d07e3b3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:31.842251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c10141ff-5371-4f46-b513-54d39d07e3b3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.842744 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c10141ff-5371-4f46-b513-54d39d07e3b3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.844393 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c10141ff-5371-4f46-b513-54d39d07e3b3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.845177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c10141ff-5371-4f46-b513-54d39d07e3b3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.846252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c10141ff-5371-4f46-b513-54d39d07e3b3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.846879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c10141ff-5371-4f46-b513-54d39d07e3b3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.919679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-d4f17cc2-00f0-4149-b362-1d9cab9a779b req-d376c005-e9a0-4661-a574-cbbaf3ab3c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f768af80-7eb3-49d3-b572-5665427c78ef", "name": "network-vif-plugged", "status": "completed", "tag": "d1dc3025-0942-4668-8591-d4a8783a2107"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:31.929306 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=8 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:31.940453 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d4f17cc2-00f0-4149-b362-1d9cab9a779b req-d376c005-e9a0-4661-a574-cbbaf3ab3c60 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:31.940990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d4f17cc2-00f0-4149-b362-1d9cab9a779b req-d376c005-e9a0-4661-a574-cbbaf3ab3c60 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:31.941542 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d4f17cc2-00f0-4149-b362-1d9cab9a779b req-d376c005-e9a0-4661-a574-cbbaf3ab3c60 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:31.955423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-d4f17cc2-00f0-4149-b362-1d9cab9a779b req-d376c005-e9a0-4661-a574-cbbaf3ab3c60 service nova] Creating event network-vif-plugged:d1dc3025-0942-4668-8591-d4a8783a2107 for instance f768af80-7eb3-49d3-b572-5665427c78ef on hv-cinder-85427 Aug 24 10:22:31.962996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-d4f17cc2-00f0-4149-b362-1d9cab9a779b req-d376c005-e9a0-4661-a574-cbbaf3ab3c60 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051536 Aug 24 10:22:31.965084 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 365/725] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:31.989817 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c10141ff-5371-4f46-b513-54d39d07e3b3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:31.999860 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c10141ff-5371-4f46-b513-54d39d07e3b3 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1367 microversion: 2.1 time: 0.170402 Aug 24 10:22:32.000680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 361/726] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:31 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:33.023631 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c846e4de-121f-41a5-b8b1-61e52d408a4a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:33.024336 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c846e4de-121f-41a5-b8b1-61e52d408a4a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:33.031752 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c846e4de-121f-41a5-b8b1-61e52d408a4a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.032239 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c846e4de-121f-41a5-b8b1-61e52d408a4a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.032724 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c846e4de-121f-41a5-b8b1-61e52d408a4a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.033490 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c846e4de-121f-41a5-b8b1-61e52d408a4a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:33.033946 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c846e4de-121f-41a5-b8b1-61e52d408a4a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:33.034371 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c846e4de-121f-41a5-b8b1-61e52d408a4a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:33.169967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c846e4de-121f-41a5-b8b1-61e52d408a4a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:33.178012 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c846e4de-121f-41a5-b8b1-61e52d408a4a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1367 microversion: 2.1 time: 0.158721 Aug 24 10:22:33.178589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 366/727] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:33 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:34.199920 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9126196d-2c3d-4e46-b5df-2921c60dd260 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:34.200770 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9126196d-2c3d-4e46-b5df-2921c60dd260 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:34.208103 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9126196d-2c3d-4e46-b5df-2921c60dd260 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.208585 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9126196d-2c3d-4e46-b5df-2921c60dd260 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.209052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9126196d-2c3d-4e46-b5df-2921c60dd260 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.209754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9126196d-2c3d-4e46-b5df-2921c60dd260 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:34.210204 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9126196d-2c3d-4e46-b5df-2921c60dd260 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:34.210668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9126196d-2c3d-4e46-b5df-2921c60dd260 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:34.356982 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9126196d-2c3d-4e46-b5df-2921c60dd260 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:34.365643 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9126196d-2c3d-4e46-b5df-2921c60dd260 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1367 microversion: 2.1 time: 0.169573 Aug 24 10:22:34.366216 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 362/728] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:34 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:35.386907 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-fc617fea-ae0a-459c-8ffd-283307a5dab7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:35.387528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-fc617fea-ae0a-459c-8ffd-283307a5dab7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:35.395089 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc617fea-ae0a-459c-8ffd-283307a5dab7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.395662 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc617fea-ae0a-459c-8ffd-283307a5dab7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.396173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc617fea-ae0a-459c-8ffd-283307a5dab7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.396893 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc617fea-ae0a-459c-8ffd-283307a5dab7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.397355 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc617fea-ae0a-459c-8ffd-283307a5dab7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.397780 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc617fea-ae0a-459c-8ffd-283307a5dab7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.528655 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fc617fea-ae0a-459c-8ffd-283307a5dab7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:22:35.536830 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-fc617fea-ae0a-459c-8ffd-283307a5dab7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1557 microversion: 2.1 time: 0.153697 Aug 24 10:22:35.537549 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 367/729] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:22:35 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:22:35.557167 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0b7b4343-7a1a-40a7-99b3-b6dbe075f89a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:35.557664 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0b7b4343-7a1a-40a7-99b3-b6dbe075f89a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:35.564516 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0b7b4343-7a1a-40a7-99b3-b6dbe075f89a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.565021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0b7b4343-7a1a-40a7-99b3-b6dbe075f89a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.565450 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0b7b4343-7a1a-40a7-99b3-b6dbe075f89a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.566136 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0b7b4343-7a1a-40a7-99b3-b6dbe075f89a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:35.566568 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0b7b4343-7a1a-40a7-99b3-b6dbe075f89a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:35.566980 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0b7b4343-7a1a-40a7-99b3-b6dbe075f89a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:35.647003 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0b7b4343-7a1a-40a7-99b3-b6dbe075f89a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093704 Aug 24 10:22:35.647748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 363/730] 10.222.0.30 () {58 vars in 1275 bytes} [Wed Aug 24 10:22:35 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:36.884987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-583de513-62c5-4944-8fa1-a9e8f8255075 req-a331f30f-d997-481a-a084-61563fa382fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f768af80-7eb3-49d3-b572-5665427c78ef", "tag": "d1dc3025-0942-4668-8591-d4a8783a2107"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:36.895149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-583de513-62c5-4944-8fa1-a9e8f8255075 req-a331f30f-d997-481a-a084-61563fa382fb service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:36.895633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-583de513-62c5-4944-8fa1-a9e8f8255075 req-a331f30f-d997-481a-a084-61563fa382fb service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:36.896064 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-583de513-62c5-4944-8fa1-a9e8f8255075 req-a331f30f-d997-481a-a084-61563fa382fb service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:36.907139 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-583de513-62c5-4944-8fa1-a9e8f8255075 req-a331f30f-d997-481a-a084-61563fa382fb service nova] Creating event network-changed:d1dc3025-0942-4668-8591-d4a8783a2107 for instance f768af80-7eb3-49d3-b572-5665427c78ef on hv-cinder-85427 Aug 24 10:22:36.912947 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-583de513-62c5-4944-8fa1-a9e8f8255075 req-a331f30f-d997-481a-a084-61563fa382fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033222 Aug 24 10:22:36.913563 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 368/731] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:42.084008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-97b2d968-cf68-42ff-ade6-eb97d87e931d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:42.084008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-97b2d968-cf68-42ff-ade6-eb97d87e931d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:42.085562 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:42.088963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-97b2d968-cf68-42ff-ade6-eb97d87e931d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:42.089434 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-97b2d968-cf68-42ff-ade6-eb97d87e931d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:42.089871 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-97b2d968-cf68-42ff-ade6-eb97d87e931d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:42.090568 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-97b2d968-cf68-42ff-ade6-eb97d87e931d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:42.091055 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-97b2d968-cf68-42ff-ade6-eb97d87e931d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:42.091479 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-97b2d968-cf68-42ff-ade6-eb97d87e931d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:42.116138 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-97b2d968-cf68-42ff-ade6-eb97d87e931d tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/ips" status: 200 len: 147 microversion: 2.1 time: 0.202993 Aug 24 10:22:42.116709 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 364/732] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Aug 24 10:22:41 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/ips => generated 147 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:43.845773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-fc479ed5-419c-4a64-adb5-ee409686ab48 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa9e610a-4879-4df4-a578-f0923fab712d"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:43.848354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-fc479ed5-419c-4a64-adb5-ee409686ab48 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:43.850389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:43.855307 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc479ed5-419c-4a64-adb5-ee409686ab48 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.855791 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc479ed5-419c-4a64-adb5-ee409686ab48 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.856228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc479ed5-419c-4a64-adb5-ee409686ab48 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:43.856956 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc479ed5-419c-4a64-adb5-ee409686ab48 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:43.857420 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc479ed5-419c-4a64-adb5-ee409686ab48 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:43.857988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fc479ed5-419c-4a64-adb5-ee409686ab48 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:44.807010 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-fc479ed5-419c-4a64-adb5-ee409686ab48 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.966122 Aug 24 10:22:44.807617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 369/733] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:22:43 2022] POST /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments => generated 194 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:22:53.410508 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-351b2d83-2d2f-46a3-9cf9-2ed6ec43857b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:53.413036 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-351b2d83-2d2f-46a3-9cf9-2ed6ec43857b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:53.415044 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=82 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:22:53.420596 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-351b2d83-2d2f-46a3-9cf9-2ed6ec43857b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:53.421111 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-351b2d83-2d2f-46a3-9cf9-2ed6ec43857b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:53.421550 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-351b2d83-2d2f-46a3-9cf9-2ed6ec43857b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:53.422251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-351b2d83-2d2f-46a3-9cf9-2ed6ec43857b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:53.422706 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-351b2d83-2d2f-46a3-9cf9-2ed6ec43857b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:53.423130 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-351b2d83-2d2f-46a3-9cf9-2ed6ec43857b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:53.452224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-351b2d83-2d2f-46a3-9cf9-2ed6ec43857b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046652 Aug 24 10:22:53.452777 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 365/734] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:22:53 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:53.465211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b08b5eb8-fe5d-413f-bc1b-8fd8149b506f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:53.465789 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b08b5eb8-fe5d-413f-bc1b-8fd8149b506f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:53.471979 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b08b5eb8-fe5d-413f-bc1b-8fd8149b506f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:53.473221 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b08b5eb8-fe5d-413f-bc1b-8fd8149b506f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:53.473601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b08b5eb8-fe5d-413f-bc1b-8fd8149b506f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:53.474288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b08b5eb8-fe5d-413f-bc1b-8fd8149b506f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:53.474760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b08b5eb8-fe5d-413f-bc1b-8fd8149b506f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:53.475211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b08b5eb8-fe5d-413f-bc1b-8fd8149b506f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:53.504436 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b08b5eb8-fe5d-413f-bc1b-8fd8149b506f tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments/fa9e610a-4879-4df4-a578-f0923fab712d" status: 200 len: 194 microversion: 2.1 time: 0.044096 Aug 24 10:22:53.505088 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 370/735] 10.222.0.30 () {58 vars in 1413 bytes} [Wed Aug 24 10:22:53 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments/fa9e610a-4879-4df4-a578-f0923fab712d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:55.290842 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4158fc18-1e38-4fea-8c4e-91fecaf9f580 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b6c0b0d-e45f-4284-bfb1-0ed632050376"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:22:55.293250 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4158fc18-1e38-4fea-8c4e-91fecaf9f580 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:55.300567 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4158fc18-1e38-4fea-8c4e-91fecaf9f580 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:55.301232 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4158fc18-1e38-4fea-8c4e-91fecaf9f580 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:55.301690 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4158fc18-1e38-4fea-8c4e-91fecaf9f580 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:55.302419 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4158fc18-1e38-4fea-8c4e-91fecaf9f580 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:55.302841 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4158fc18-1e38-4fea-8c4e-91fecaf9f580 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:55.303266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4158fc18-1e38-4fea-8c4e-91fecaf9f580 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:56.412258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4158fc18-1e38-4fea-8c4e-91fecaf9f580 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "POST /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.125541 Aug 24 10:22:56.420176 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 366/736] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:22:55 2022] POST /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments => generated 194 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:22:58.249214 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4df475a9-d6e5-4b4a-b7d5-d5ed6ded3f71 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:22:58.249787 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4df475a9-d6e5-4b4a-b7d5-d5ed6ded3f71 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:22:58.256841 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4df475a9-d6e5-4b4a-b7d5-d5ed6ded3f71 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:58.257343 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4df475a9-d6e5-4b4a-b7d5-d5ed6ded3f71 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:58.257772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4df475a9-d6e5-4b4a-b7d5-d5ed6ded3f71 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:58.258454 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4df475a9-d6e5-4b4a-b7d5-d5ed6ded3f71 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:22:58.258902 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4df475a9-d6e5-4b4a-b7d5-d5ed6ded3f71 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:22:58.259321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4df475a9-d6e5-4b4a-b7d5-d5ed6ded3f71 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:22:58.283149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4df475a9-d6e5-4b4a-b7d5-d5ed6ded3f71 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/ips" status: 200 len: 152 microversion: 2.20 time: 0.037770 Aug 24 10:22:58.283722 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 371/737] 10.222.0.30 () {60 vars in 1289 bytes} [Wed Aug 24 10:22:58 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 10:23:01.058924 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4f6ea6ca-9e66-487f-8464-9a2c25918c60 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:01.059462 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4f6ea6ca-9e66-487f-8464-9a2c25918c60 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:01.065624 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f6ea6ca-9e66-487f-8464-9a2c25918c60 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:01.066105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f6ea6ca-9e66-487f-8464-9a2c25918c60 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:01.066542 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f6ea6ca-9e66-487f-8464-9a2c25918c60 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:01.067230 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f6ea6ca-9e66-487f-8464-9a2c25918c60 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:01.067676 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f6ea6ca-9e66-487f-8464-9a2c25918c60 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:01.068761 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4f6ea6ca-9e66-487f-8464-9a2c25918c60 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:01.091987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-4f6ea6ca-9e66-487f-8464-9a2c25918c60 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lazy-loading 'flavor' on Instance uuid 246f3e69-c7bf-462e-88a0-e209d93b5603 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:01.666378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4f6ea6ca-9e66-487f-8464-9a2c25918c60 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "POST /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/action" status: 202 len: 0 microversion: 2.20 time: 0.612165 Aug 24 10:23:01.666976 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 367/738] 10.222.0.30 () {62 vars in 1319 bytes} [Wed Aug 24 10:23:01 2022] POST /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:01.675659 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:01.676292 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:01.683446 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:01.684040 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:01.684400 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:01.685133 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:01.685588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:01.686013 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:01.688839 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:01.831182 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:01.840019 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:01.841583 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:01.842754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-512eacf4-ee25-4d96-95ac-7de8aae061c9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.171242 Aug 24 10:23:01.843307 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 372/739] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:01 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:02.867875 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:02.868557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:02.875839 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:02.881948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:02.881948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:02.881948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:02.881948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:02.882331 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:03.019253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:03.028001 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:03.029734 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:03.030898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7b3aa0f3-d389-4084-bd11-5821689e7b7b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.167834 Aug 24 10:23:03.031517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 368/740] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:02 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:04.055278 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:04.055909 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:04.062728 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:04.063208 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:04.063644 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:04.064337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:04.064796 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:04.065249 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:04.195970 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.204473 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.206019 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:04.207176 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2d148381-1433-4380-b021-137249bd233b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.156863 Aug 24 10:23:04.207725 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 373/741] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:04 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:05.230527 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:05.231067 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:05.238036 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:05.238759 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:05.239184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:05.239877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:05.240544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:05.240998 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:05.385031 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:05.393143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:05.394653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:05.395814 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-436c84c9-11f2-4e57-97da-615918fb5044 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.169274 Aug 24 10:23:05.396990 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 369/742] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:05 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:06.419031 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:06.419783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:06.426159 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:06.426624 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:06.427049 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:06.428227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:06.428665 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:06.429105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:06.565980 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:06.574126 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:06.575627 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:06.576770 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-df0d9a21-7499-4c01-b78f-96b17ce15f07 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.161619 Aug 24 10:23:06.577355 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 374/743] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:06 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:07.599394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:07.600009 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:07.606639 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:07.607119 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:07.607550 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:07.608267 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:07.608721 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:07.609163 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:07.737927 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:07.749007 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:07.750515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:07.751710 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b024bc77-0ffa-4f1f-b370-04e0dab08f6c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.156248 Aug 24 10:23:07.752271 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 370/744] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:07 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:08.775952 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:08.776554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:08.783231 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.783789 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.784221 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.784932 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.785423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.785845 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.918115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:08.926190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:08.927695 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:08.929044 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7bd688c0-ac38-4982-ad3f-f0f642efffdf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.157564 Aug 24 10:23:08.929529 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 375/745] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:08 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:09.359374 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b2d79954-0e69-4b65-ac7f-b4a4c0060804 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:09.361962 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b2d79954-0e69-4b65-ac7f-b4a4c0060804 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:09.369261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2d79954-0e69-4b65-ac7f-b4a4c0060804 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.371849 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2d79954-0e69-4b65-ac7f-b4a4c0060804 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.371849 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2d79954-0e69-4b65-ac7f-b4a4c0060804 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.371849 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2d79954-0e69-4b65-ac7f-b4a4c0060804 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.371849 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2d79954-0e69-4b65-ac7f-b4a4c0060804 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.372669 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b2d79954-0e69-4b65-ac7f-b4a4c0060804 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.403201 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b2d79954-0e69-4b65-ac7f-b4a4c0060804 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047841 Aug 24 10:23:09.403751 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 371/746] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:23:09 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:09.544448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c65fd46e-db78-4fd1-a524-13bf7b8c36cd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:09.544875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c65fd46e-db78-4fd1-a524-13bf7b8c36cd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:09.551106 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c65fd46e-db78-4fd1-a524-13bf7b8c36cd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.555356 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c65fd46e-db78-4fd1-a524-13bf7b8c36cd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.555356 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c65fd46e-db78-4fd1-a524-13bf7b8c36cd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.555356 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c65fd46e-db78-4fd1-a524-13bf7b8c36cd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.555356 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c65fd46e-db78-4fd1-a524-13bf7b8c36cd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.555740 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c65fd46e-db78-4fd1-a524-13bf7b8c36cd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.582906 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c65fd46e-db78-4fd1-a524-13bf7b8c36cd tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments/fa9e610a-4879-4df4-a578-f0923fab712d" status: 200 len: 194 microversion: 2.1 time: 0.042468 Aug 24 10:23:09.583479 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 376/747] 10.222.0.30 () {58 vars in 1413 bytes} [Wed Aug 24 10:23:09 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments/fa9e610a-4879-4df4-a578-f0923fab712d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:23:09.594068 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bd7ae1fc-3990-451f-ab74-f2a46c231fbc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:09.594560 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bd7ae1fc-3990-451f-ab74-f2a46c231fbc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:09.601426 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bd7ae1fc-3990-451f-ab74-f2a46c231fbc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.601912 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bd7ae1fc-3990-451f-ab74-f2a46c231fbc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.602374 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bd7ae1fc-3990-451f-ab74-f2a46c231fbc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.603072 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bd7ae1fc-3990-451f-ab74-f2a46c231fbc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.603525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bd7ae1fc-3990-451f-ab74-f2a46c231fbc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.603949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bd7ae1fc-3990-451f-ab74-f2a46c231fbc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.689713 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-bd7ae1fc-3990-451f-ab74-f2a46c231fbc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lazy-loading 'services' on Instance uuid 48253b3e-b4c6-433a-af33-f6e0b3bfb514 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:09.900376 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bd7ae1fc-3990-451f-ab74-f2a46c231fbc tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "DELETE /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments/fa9e610a-4879-4df4-a578-f0923fab712d" status: 202 len: 0 microversion: 2.1 time: 0.310165 Aug 24 10:23:09.901116 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 372/748] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:23:09 2022] DELETE /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments/fa9e610a-4879-4df4-a578-f0923fab712d => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:09.951789 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:09.952404 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:09.959156 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.960231 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.960671 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.961430 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.966370 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.966370 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:10.102811 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:10.111287 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:10.112774 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:10.114079 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4e9008b1-f2a9-424e-86e1-0c561854fcac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.166468 Aug 24 10:23:10.114636 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 377/749] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:09 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:11.137979 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:11.138673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:11.144710 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.145214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.145640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.146322 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.146767 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.147299 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.286971 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:11.296182 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:11.297699 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:11.299043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-303b4e8d-336d-443a-84ee-a4d973e42411 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.165869 Aug 24 10:23:11.299595 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 373/750] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:11 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:12.088689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6e441735-7d89-4bbb-a388-c89cb009660b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:12.089246 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-6e441735-7d89-4bbb-a388-c89cb009660b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:12.095592 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e441735-7d89-4bbb-a388-c89cb009660b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.096102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e441735-7d89-4bbb-a388-c89cb009660b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.096538 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e441735-7d89-4bbb-a388-c89cb009660b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.097256 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e441735-7d89-4bbb-a388-c89cb009660b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.097706 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e441735-7d89-4bbb-a388-c89cb009660b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.098130 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-6e441735-7d89-4bbb-a388-c89cb009660b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.127514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-6e441735-7d89-4bbb-a388-c89cb009660b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments/5b6c0b0d-e45f-4284-bfb1-0ed632050376" status: 200 len: 194 microversion: 2.1 time: 0.042809 Aug 24 10:23:12.128088 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 378/751] 10.222.0.30 () {58 vars in 1413 bytes} [Wed Aug 24 10:23:12 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments/5b6c0b0d-e45f-4284-bfb1-0ed632050376 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:12.138816 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4fa3d47b-cd60-4ebf-936f-ab0b1fbdb4d9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:12.139293 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4fa3d47b-cd60-4ebf-936f-ab0b1fbdb4d9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:12.145642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa3d47b-cd60-4ebf-936f-ab0b1fbdb4d9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.146123 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa3d47b-cd60-4ebf-936f-ab0b1fbdb4d9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.146552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa3d47b-cd60-4ebf-936f-ab0b1fbdb4d9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.147965 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa3d47b-cd60-4ebf-936f-ab0b1fbdb4d9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.148411 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa3d47b-cd60-4ebf-936f-ab0b1fbdb4d9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.148829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa3d47b-cd60-4ebf-936f-ab0b1fbdb4d9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.227774 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-4fa3d47b-cd60-4ebf-936f-ab0b1fbdb4d9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lazy-loading 'services' on Instance uuid 48253b3e-b4c6-433a-af33-f6e0b3bfb514 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:12.324080 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:12.324693 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:12.330932 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.331571 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.332008 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.332700 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:12.333172 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:12.333647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:12.480566 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:12.482161 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:12.483647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:12.484841 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4afe7865-6f8c-4493-9868-8ce9eba1719b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.165288 Aug 24 10:23:12.485426 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 379/752] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:12 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:12.641326 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4fa3d47b-cd60-4ebf-936f-ab0b1fbdb4d9 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "DELETE /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments/5b6c0b0d-e45f-4284-bfb1-0ed632050376" status: 202 len: 0 microversion: 2.1 time: 0.506178 Aug 24 10:23:12.642216 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 374/753] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:23:12 2022] DELETE /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments/5b6c0b0d-e45f-4284-bfb1-0ed632050376 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:13.508402 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:13.509047 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:13.515550 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:13.516131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:13.516578 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:13.517298 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:13.517755 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:13.518182 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:13.648599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:13.657442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:13.658928 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:13.660261 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-52fdc80f-e5e2-4ed7-916a-0650e35d7a56 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.156113 Aug 24 10:23:13.661375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 380/754] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:13 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:14.684769 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:14.685559 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:14.692873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:14.693374 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:14.693814 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:14.694516 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:14.694988 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:14.695385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:14.853213 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:14.862166 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:14.863748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:14.864982 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5fc9ca4a-cd76-4f41-bc4a-892a4cff46ac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1745 microversion: 2.20 time: 0.184897 Aug 24 10:23:14.877085 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 375/755] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:14 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:14.889375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f2b48fba-598e-4738-aa51-11114f3b3fce tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:14.891695 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f2b48fba-598e-4738-aa51-11114f3b3fce tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:14.894250 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=24 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:14.899591 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f2b48fba-598e-4738-aa51-11114f3b3fce tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:14.900106 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f2b48fba-598e-4738-aa51-11114f3b3fce tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:14.900545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f2b48fba-598e-4738-aa51-11114f3b3fce tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:14.901284 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f2b48fba-598e-4738-aa51-11114f3b3fce tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:14.901744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f2b48fba-598e-4738-aa51-11114f3b3fce tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:14.902169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f2b48fba-598e-4738-aa51-11114f3b3fce tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:14.931160 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f2b48fba-598e-4738-aa51-11114f3b3fce tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045738 Aug 24 10:23:14.931726 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 381/756] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:23:14 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:23:15.049572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9073dd49-86cc-497c-b178-27976768d46a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:15.051811 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9073dd49-86cc-497c-b178-27976768d46a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:15.057895 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9073dd49-86cc-497c-b178-27976768d46a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.058381 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9073dd49-86cc-497c-b178-27976768d46a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.058817 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9073dd49-86cc-497c-b178-27976768d46a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:15.059510 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9073dd49-86cc-497c-b178-27976768d46a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.059958 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9073dd49-86cc-497c-b178-27976768d46a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.060398 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9073dd49-86cc-497c-b178-27976768d46a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:15.086658 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:15.090883 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9073dd49-86cc-497c-b178-27976768d46a tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045201 Aug 24 10:23:15.091440 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 376/757] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:23:15 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:23:15.154009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0fa993bb-a9fe-4b22-b512-783e9d27c0ec tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:15.154518 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0fa993bb-a9fe-4b22-b512-783e9d27c0ec tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:15.160874 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0fa993bb-a9fe-4b22-b512-783e9d27c0ec tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.161349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0fa993bb-a9fe-4b22-b512-783e9d27c0ec tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.161775 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0fa993bb-a9fe-4b22-b512-783e9d27c0ec tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:15.162449 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0fa993bb-a9fe-4b22-b512-783e9d27c0ec tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.163176 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0fa993bb-a9fe-4b22-b512-783e9d27c0ec tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.163607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0fa993bb-a9fe-4b22-b512-783e9d27c0ec tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:15.189028 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0fa993bb-a9fe-4b22-b512-783e9d27c0ec tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:15.525544 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0fa993bb-a9fe-4b22-b512-783e9d27c0ec tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "DELETE /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 204 len: 0 microversion: 2.1 time: 0.375171 Aug 24 10:23:15.526133 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 382/758] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:15 2022] DELETE /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:15.534262 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ab611bd3-2141-4486-b12e-3eaf8f461a7b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:15.534868 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ab611bd3-2141-4486-b12e-3eaf8f461a7b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:15.542355 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab611bd3-2141-4486-b12e-3eaf8f461a7b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.542827 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab611bd3-2141-4486-b12e-3eaf8f461a7b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.543250 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab611bd3-2141-4486-b12e-3eaf8f461a7b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:15.543931 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab611bd3-2141-4486-b12e-3eaf8f461a7b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.544376 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab611bd3-2141-4486-b12e-3eaf8f461a7b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.544790 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ab611bd3-2141-4486-b12e-3eaf8f461a7b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:15.676432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ab611bd3-2141-4486-b12e-3eaf8f461a7b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:15.684560 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ab611bd3-2141-4486-b12e-3eaf8f461a7b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1675 microversion: 2.1 time: 0.154064 Aug 24 10:23:15.685360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 377/759] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:15 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:15.888976 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:15.889676 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:15.898977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.899466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.899897 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:15.900614 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:15.901085 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:15.901509 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.037417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:16.046611 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:16.048126 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:16.049329 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f288f63d-4db2-4d9d-ac07-a446a727c837 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1745 microversion: 2.20 time: 0.164848 Aug 24 10:23:16.049903 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 383/760] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:15 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:16.706656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7279a37b-cf11-46c0-a088-224bd5f9ec00 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:16.707267 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7279a37b-cf11-46c0-a088-224bd5f9ec00 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:16.714095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7279a37b-cf11-46c0-a088-224bd5f9ec00 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.714570 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7279a37b-cf11-46c0-a088-224bd5f9ec00 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.715006 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7279a37b-cf11-46c0-a088-224bd5f9ec00 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.715689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7279a37b-cf11-46c0-a088-224bd5f9ec00 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.716138 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7279a37b-cf11-46c0-a088-224bd5f9ec00 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.716560 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7279a37b-cf11-46c0-a088-224bd5f9ec00 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.848392 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7279a37b-cf11-46c0-a088-224bd5f9ec00 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:16.856253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7279a37b-cf11-46c0-a088-224bd5f9ec00 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1675 microversion: 2.1 time: 0.153400 Aug 24 10:23:16.856888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 378/761] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:16 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:17.072843 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:17.073470 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:17.079978 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:17.080450 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:17.080894 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:17.081575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:17.082019 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:17.082460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:17.211946 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:17.220185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:17.221713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:17.222859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f6dae04f-a937-474c-bd5a-5b7064db12a5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1745 microversion: 2.20 time: 0.154342 Aug 24 10:23:17.223413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 384/762] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:17 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:17.878254 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9b73fd46-e694-486e-aad5-0bce59a0f288 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:17.878861 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9b73fd46-e694-486e-aad5-0bce59a0f288 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:17.885935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b73fd46-e694-486e-aad5-0bce59a0f288 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:17.886415 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b73fd46-e694-486e-aad5-0bce59a0f288 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:17.886847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b73fd46-e694-486e-aad5-0bce59a0f288 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:17.887541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b73fd46-e694-486e-aad5-0bce59a0f288 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:17.887990 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b73fd46-e694-486e-aad5-0bce59a0f288 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:17.888435 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b73fd46-e694-486e-aad5-0bce59a0f288 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:18.018527 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9b73fd46-e694-486e-aad5-0bce59a0f288 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:18.027152 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9b73fd46-e694-486e-aad5-0bce59a0f288 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1675 microversion: 2.1 time: 0.152752 Aug 24 10:23:18.027735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 379/763] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:17 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:18.246580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:18.247142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:18.253615 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:18.254097 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:18.254531 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:18.255216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:18.255672 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:18.256372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:18.390739 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:18.399901 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:18.401417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:18.402575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e8fe127f-b11c-4168-825a-8e0f0f97397d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1745 microversion: 2.20 time: 0.160013 Aug 24 10:23:18.403139 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 385/764] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:18 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:19.048917 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-eda39625-e9b2-4b67-bf5e-c5fc1423e982 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:19.049531 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-eda39625-e9b2-4b67-bf5e-c5fc1423e982 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:19.056604 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eda39625-e9b2-4b67-bf5e-c5fc1423e982 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.057108 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eda39625-e9b2-4b67-bf5e-c5fc1423e982 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.057546 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eda39625-e9b2-4b67-bf5e-c5fc1423e982 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.058232 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eda39625-e9b2-4b67-bf5e-c5fc1423e982 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.058684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eda39625-e9b2-4b67-bf5e-c5fc1423e982 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.059105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-eda39625-e9b2-4b67-bf5e-c5fc1423e982 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.191674 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-eda39625-e9b2-4b67-bf5e-c5fc1423e982 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:19.199240 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-eda39625-e9b2-4b67-bf5e-c5fc1423e982 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1675 microversion: 2.1 time: 0.154171 Aug 24 10:23:19.199802 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 380/765] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:19 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:19.428431 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:19.429272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:19.436191 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.436673 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.437141 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.437837 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.438294 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.438716 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.571299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:19.579572 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:19.581127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:19.582293 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bb69c834-d03f-47a8-87b9-b41c1a5a6676 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1745 microversion: 2.20 time: 0.158043 Aug 24 10:23:19.582852 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 386/766] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:19 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:19.813396 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-e05b47d5-4327-46f1-b3cb-38f3665327f2 req-fa7635c7-20b3-422b-9383-5145e9974287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246f3e69-c7bf-462e-88a0-e209d93b5603", "name": "network-vif-plugged", "status": "completed", "tag": "a92e393c-0dd2-4ec0-8147-c860a2c195f8"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:19.823445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e05b47d5-4327-46f1-b3cb-38f3665327f2 req-fa7635c7-20b3-422b-9383-5145e9974287 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.823865 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e05b47d5-4327-46f1-b3cb-38f3665327f2 req-fa7635c7-20b3-422b-9383-5145e9974287 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.824294 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e05b47d5-4327-46f1-b3cb-38f3665327f2 req-fa7635c7-20b3-422b-9383-5145e9974287 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.835009 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-e05b47d5-4327-46f1-b3cb-38f3665327f2 req-fa7635c7-20b3-422b-9383-5145e9974287 service nova] Creating event network-vif-plugged:a92e393c-0dd2-4ec0-8147-c860a2c195f8 for instance 246f3e69-c7bf-462e-88a0-e209d93b5603 on hv-cinder-85427 Aug 24 10:23:19.839820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-e05b47d5-4327-46f1-b3cb-38f3665327f2 req-fa7635c7-20b3-422b-9383-5145e9974287 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085689 Aug 24 10:23:19.840416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 381/767] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:20.220621 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-fecd4ad7-fcf9-48dd-9cf8-a20df18263ac tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:20.221330 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-fecd4ad7-fcf9-48dd-9cf8-a20df18263ac tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:20.227846 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fecd4ad7-fcf9-48dd-9cf8-a20df18263ac tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.228325 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fecd4ad7-fcf9-48dd-9cf8-a20df18263ac tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.231058 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fecd4ad7-fcf9-48dd-9cf8-a20df18263ac tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.231058 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fecd4ad7-fcf9-48dd-9cf8-a20df18263ac tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.231058 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fecd4ad7-fcf9-48dd-9cf8-a20df18263ac tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.231058 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fecd4ad7-fcf9-48dd-9cf8-a20df18263ac tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.234296 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:20.368708 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fecd4ad7-fcf9-48dd-9cf8-a20df18263ac tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:20.377157 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-fecd4ad7-fcf9-48dd-9cf8-a20df18263ac tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1675 microversion: 2.1 time: 0.160164 Aug 24 10:23:20.377953 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 387/768] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:20 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:20.608403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:20.609742 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:20.620727 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.621249 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.621708 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.622416 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.622872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.623298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.902544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:20.911456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:20.914097 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:20.914900 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3b8b6ac6-16b3-4021-b09e-fccc588d722e tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.312408 Aug 24 10:23:20.915471 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 382/769] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:20 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:21.402353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f7d0998b-d80a-4ce1-981a-b73fcf0d6216 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:21.402909 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f7d0998b-d80a-4ce1-981a-b73fcf0d6216 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:21.421210 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-8b4fac9a-0e7a-457c-acfa-104c7a54e60e req-598ae8b8-e61d-4eb5-a212-3bc0785d343b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48253b3e-b4c6-433a-af33-f6e0b3bfb514", "name": "network-vif-deleted", "tag": "b0757913-6b28-49a7-b3f0-287737878f96"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:21.431759 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7d0998b-d80a-4ce1-981a-b73fcf0d6216 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.433262 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-8b4fac9a-0e7a-457c-acfa-104c7a54e60e req-598ae8b8-e61d-4eb5-a212-3bc0785d343b service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.433396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7d0998b-d80a-4ce1-981a-b73fcf0d6216 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.433746 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-8b4fac9a-0e7a-457c-acfa-104c7a54e60e req-598ae8b8-e61d-4eb5-a212-3bc0785d343b service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.434028 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7d0998b-d80a-4ce1-981a-b73fcf0d6216 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.434184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-8b4fac9a-0e7a-457c-acfa-104c7a54e60e req-598ae8b8-e61d-4eb5-a212-3bc0785d343b service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.435241 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7d0998b-d80a-4ce1-981a-b73fcf0d6216 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.436308 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7d0998b-d80a-4ce1-981a-b73fcf0d6216 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.437568 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7d0998b-d80a-4ce1-981a-b73fcf0d6216 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.448195 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-8b4fac9a-0e7a-457c-acfa-104c7a54e60e req-598ae8b8-e61d-4eb5-a212-3bc0785d343b service nova] Creating event network-vif-deleted:b0757913-6b28-49a7-b3f0-287737878f96 for instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 on hv-cinder-85427 Aug 24 10:23:21.454087 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-8b4fac9a-0e7a-457c-acfa-104c7a54e60e req-598ae8b8-e61d-4eb5-a212-3bc0785d343b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037009 Aug 24 10:23:21.458119 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 383/770] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:23:21.546610 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f7d0998b-d80a-4ce1-981a-b73fcf0d6216 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:21.555760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f7d0998b-d80a-4ce1-981a-b73fcf0d6216 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1607 microversion: 2.1 time: 0.159287 Aug 24 10:23:21.571548 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 388/771] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:21 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1607 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:21.781903 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5f6b9d83-6adf-41dd-a83c-31d39935b5c6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:21.783407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5f6b9d83-6adf-41dd-a83c-31d39935b5c6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:21.791045 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f6b9d83-6adf-41dd-a83c-31d39935b5c6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.791541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f6b9d83-6adf-41dd-a83c-31d39935b5c6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.791979 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f6b9d83-6adf-41dd-a83c-31d39935b5c6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.792699 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f6b9d83-6adf-41dd-a83c-31d39935b5c6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.793179 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f6b9d83-6adf-41dd-a83c-31d39935b5c6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.793837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f6b9d83-6adf-41dd-a83c-31d39935b5c6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.820066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5f6b9d83-6adf-41dd-a83c-31d39935b5c6 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/ips" status: 200 len: 149 microversion: 2.1 time: 0.043121 Aug 24 10:23:21.828027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 384/772] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Aug 24 10:23:21 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:21.940402 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:21.941438 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:21.954332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.957056 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.960215 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.961096 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.963829 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.964347 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.155960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:22.167538 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:22.169417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:22.170873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-95c44efb-9e11-4d57-965b-983227a07f3b tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.234413 Aug 24 10:23:22.172015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 389/773] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:21 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:22.580100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:22.597930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:22.597930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.597930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.597930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.598264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.598264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.598264 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.635942 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.636663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.637269 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.637891 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lazy-loading 'fault' on Instance uuid 48253b3e-b4c6-433a-af33-f6e0b3bfb514 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:22.697702 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c5ac35123e425e9753f372f9c6bac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '297fa582000543acbf078376d7010abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:22.708533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7d461df9-9849-4cf7-bdc3-08cbfee3b488 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 200 len: 1327 microversion: 2.1 time: 0.133385 Aug 24 10:23:22.715444 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 385/774] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:22 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 1327 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:23.202109 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:23.202721 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:23.222922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.223894 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.224647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.225698 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.226688 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.227282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.437968 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:23.449564 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:23.451144 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:23.452387 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-42bd12ff-89f9-4cc4-b702-4c45f97a727a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.254858 Aug 24 10:23:23.453113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 390/775] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:23 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:23.737913 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:23.738755 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:23.745894 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.746660 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.747561 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.748620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:23.749096 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:23.749680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:23.764618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] HTTP exception thrown: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Request method failure captured: Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 HTTP/1.1 Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqjHR2oq5wAV2cX5T_IYKFIMWiXuRXYF-wmrhwuPpVxfX4GAQpPkiAZKZbvkBPIYfoldoJxF29v57eZfMrQqc-MSr5mmH9_EbZnicFJA7hwhH_yCsGUKyjP1xxZWms_lX_c0buWRNL5OP1Dk7Frkuiygg8ZMPDJFu9li67c6qGh6Cs Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 297fa582000543acbf078376d7010abb Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:23.766325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_297fa582000543acbf078376d7010abb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/297fa582000543acbf078376d7010abb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 297fa582000543acbf078376d7010abb Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 71c5ac35123e425e9753f372f9c6bac0 Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:23.767801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '48253b3e-b4c6-433a-af33-f6e0b3bfb514'} Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:23.768725 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:23.770880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:23.773863 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Returning 404 to user: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:23.773863 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a3349874-a8b5-4944-911d-4554ac0c3a2b tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 404 len: 111 microversion: 2.1 time: 0.034154 Aug 24 10:23:23.773863 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 386/776] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:23 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:23.778340 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7da99994-08f2-4d73-83b1-7d38e55141f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '.version_select at 0x7f0af404de50>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:23.928936 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7da99994-08f2-4d73-83b1-7d38e55141f1 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362125495" status: 202 len: 0 microversion: 2.1 time: 0.154596 Aug 24 10:23:23.929875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 391/777] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Aug 24 10:23:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362125495 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:24.479007 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:24.480016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:24.487097 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:24.489011 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:24.489011 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:24.489011 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:24.489492 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:24.490043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:24.645878 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:24.655627 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:24.657244 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:24.658848 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4b5687b8-3292-4639-9d3d-802f3d47bb40 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.184572 Aug 24 10:23:24.659599 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 387/778] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:24 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:25.060923 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-07f38f92-ec97-4415-aa29-abb84a1c9533 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e50a9c5-641a-4964-bfe6-d21728c3dfd4"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:25.064976 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-07f38f92-ec97-4415-aa29-abb84a1c9533 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:25.073009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-07f38f92-ec97-4415-aa29-abb84a1c9533 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:25.078353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-07f38f92-ec97-4415-aa29-abb84a1c9533 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:25.078353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-07f38f92-ec97-4415-aa29-abb84a1c9533 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:25.078353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-07f38f92-ec97-4415-aa29-abb84a1c9533 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:25.078353 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-07f38f92-ec97-4415-aa29-abb84a1c9533 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:25.078692 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-07f38f92-ec97-4415-aa29-abb84a1c9533 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:25.684295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:25.685558 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:25.688942 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=50 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:25.692563 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:25.693313 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:25.694810 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:25.695895 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:25.696706 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:25.697340 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:25.861601 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:25.872415 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:25.874040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:25.875232 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c7c15c1e-4940-478c-8b1e-03e895f20ada tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.194888 Aug 24 10:23:25.876094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 388/779] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:25 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:26.310334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-07f38f92-ec97-4415-aa29-abb84a1c9533 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "POST /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.255370 Aug 24 10:23:26.311089 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 392/780] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:23:25 2022] POST /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments => generated 194 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:26.901600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:26.903245 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:26.911005 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:26.911481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:26.911942 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:26.913088 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:26.913684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:26.914112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.067219 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:27.077082 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:27.079048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:27.080557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-59d29394-1c36-436d-93e1-f053b0b06725 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.184312 Aug 24 10:23:27.081560 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 389/781] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:26 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:27.750592 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:27.751587 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:27.760545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.761330 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.761987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.763064 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.763682 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.764268 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.780586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] HTTP exception thrown: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Request method failure captured: Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: DELETE /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 HTTP/1.1 Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfqjHR2oq5wAV2cX5T_IYKFIMWiXuRXYF-wmrhwuPpVxfX4GAQpPkiAZKZbvkBPIYfoldoJxF29v57eZfMrQqc-MSr5mmH9_EbZnicFJA7hwhH_yCsGUKyjP1xxZWms_lX_c0buWRNL5OP1Dk7Frkuiygg8ZMPDJFu9li67c6qGh6Cs Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 297fa582000543acbf078376d7010abb Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:23:27.782365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_297fa582000543acbf078376d7010abb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/297fa582000543acbf078376d7010abb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 297fa582000543acbf078376d7010abb Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 71c5ac35123e425e9753f372f9c6bac0 Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:27.784733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '48253b3e-b4c6-433a-af33-f6e0b3bfb514'} Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:27.786299 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:27.788703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:27.791209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Returning 404 to user: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:27.791209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3a3a9d5f-4062-4f0e-946e-210d325516e6 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "DELETE /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 404 len: 111 microversion: 2.1 time: 0.039095 Aug 24 10:23:27.791209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 393/782] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:27 2022] DELETE /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:27.793672 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:27.794291 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 48253b3e-b4c6-433a-af33-f6e0b3bfb514] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:27.801107 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.801601 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.802032 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.802826 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:27.803462 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:27.803897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:27.825253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] HTTP exception thrown: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Request method failure captured: Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 HTTP/1.1 Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqjHR2oq5wAV2cX5T_IYKFIMWiXuRXYF-wmrhwuPpVxfX4GAQpPkiAZKZbvkBPIYfoldoJxF29v57eZfMrQqc-MSr5mmH9_EbZnicFJA7hwhH_yCsGUKyjP1xxZWms_lX_c0buWRNL5OP1Dk7Frkuiygg8ZMPDJFu9li67c6qGh6Cs Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 297fa582000543acbf078376d7010abb Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:27.826806 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_297fa582000543acbf078376d7010abb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/297fa582000543acbf078376d7010abb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 297fa582000543acbf078376d7010abb Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 71c5ac35123e425e9753f372f9c6bac0 Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:27.828325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '48253b3e-b4c6-433a-af33-f6e0b3bfb514'} Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:27.829150 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. Aug 24 10:23:27.830631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:27.831906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Returning 404 to user: Instance 48253b3e-b4c6-433a-af33-f6e0b3bfb514 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:27.831906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9f70de79-62f1-452c-bbcc-fce36a6459a5 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514" status: 404 len: 111 microversion: 2.1 time: 0.038574 Aug 24 10:23:27.831906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 390/783] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:27 2022] GET /compute/v2.1/servers/48253b3e-b4c6-433a-af33-f6e0b3bfb514 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:28.107934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:28.108540 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:28.114733 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.119630 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.119630 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.119630 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:28.119630 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:28.120027 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:28.253285 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.264979 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.266601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:28.269040 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3acc6264-9517-41db-9030-75aeeed6a5ce tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.164753 Aug 24 10:23:28.270266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 394/784] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:28 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:29.308990 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:29.310046 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:29.316744 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.317992 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.319019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.319777 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.320285 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.320767 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.517084 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:29.530781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:29.532405 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:29.534046 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:29.534779 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:29.535856 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bf64a7b1-3c50-46ce-9704-1558bdd541c0 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.231638 Aug 24 10:23:29.536647 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 391/785] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:29 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:29.544321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.545259 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.545917 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.547253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.550437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.551305 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.567432 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] HTTP exception thrown: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Request method failure captured: Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: DELETE /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c HTTP/1.1 Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfqjHR2oq5wAV2cX5T_IYKFIMWiXuRXYF-wmrhwuPpVxfX4GAQpPkiAZKZbvkBPIYfoldoJxF29v57eZfMrQqc-MSr5mmH9_EbZnicFJA7hwhH_yCsGUKyjP1xxZWms_lX_c0buWRNL5OP1Dk7Frkuiygg8ZMPDJFu9li67c6qGh6Cs Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 297fa582000543acbf078376d7010abb Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:23:29.569792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_297fa582000543acbf078376d7010abb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/297fa582000543acbf078376d7010abb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 297fa582000543acbf078376d7010abb Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 71c5ac35123e425e9753f372f9c6bac0 Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:23:29.572224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '29717cf7-618e-46fd-96cd-12597975a07c'} Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:29.572966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:23:29.574154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:29.575537 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Returning 404 to user: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:29.575537 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-75266f04-24c5-4e0a-b26e-1b27419ed7b8 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "DELETE /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 404 len: 111 microversion: 2.1 time: 0.045805 Aug 24 10:23:29.576350 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 395/786] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:29 2022] DELETE /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:23:29.595469 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:29.596282 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] [instance: 29717cf7-618e-46fd-96cd-12597975a07c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:29.604940 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.605721 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.606258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.607229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:29.608115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:29.608782 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:29.627848 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] HTTP exception thrown: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Request method failure captured: Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c HTTP/1.1 Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqjHR2oq5wAV2cX5T_IYKFIMWiXuRXYF-wmrhwuPpVxfX4GAQpPkiAZKZbvkBPIYfoldoJxF29v57eZfMrQqc-MSr5mmH9_EbZnicFJA7hwhH_yCsGUKyjP1xxZWms_lX_c0buWRNL5OP1Dk7Frkuiygg8ZMPDJFu9li67c6qGh6Cs Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 297fa582000543acbf078376d7010abb Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:29.629984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_297fa582000543acbf078376d7010abb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/297fa582000543acbf078376d7010abb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/297fa582000543acbf078376d7010abb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 297fa582000543acbf078376d7010abb Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1662939030 Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 71c5ac35123e425e9753f372f9c6bac0 Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeTestJSON-1662939030-project Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:23:29.632297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '29717cf7-618e-46fd-96cd-12597975a07c'} Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:29.633164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. Aug 24 10:23:29.634339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:29.637120 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] Returning 404 to user: Instance 29717cf7-618e-46fd-96cd-12597975a07c could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:29.638336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0826be6b-0c56-4487-b877-869b9af68d11 tempest-AttachVolumeTestJSON-1662939030 tempest-AttachVolumeTestJSON-1662939030-project] 10.222.0.30 "GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c" status: 404 len: 111 microversion: 2.1 time: 0.048682 Aug 24 10:23:29.639591 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 392/787] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:29 2022] GET /compute/v2.1/servers/29717cf7-618e-46fd-96cd-12597975a07c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:30.878226 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:30.879015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:30.891073 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.891507 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.891971 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:30.892689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:30.893179 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:30.893613 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:31.119962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:31.128086 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:31.129947 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:31.131386 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3e69395d-a5cd-4833-ac38-b5f9fced76a3 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.573271 Aug 24 10:23:31.136782 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 396/788] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:30 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:32.159346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:32.160049 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:32.167628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:32.168094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:32.168514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:32.169471 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:32.169773 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:32.170192 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:32.337583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:32.351131 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:32.357038 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:32.359372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-30b64f46-7c9b-4f65-aabb-0f1b970fc034 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.203954 Aug 24 10:23:32.375236 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 393/789] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:32 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:33.392327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:33.393261 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:33.400307 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:33.400728 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:33.401199 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:33.401897 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:33.402349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:33.402776 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:33.560323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:33.570090 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:33.571673 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:33.573301 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-942bbf60-58d2-4922-b93c-3734c11f284f tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1740 microversion: 2.20 time: 0.185540 Aug 24 10:23:33.582167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 397/790] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:33 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:34.486100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a729cb95-d499-49de-95e6-62b09ea2ff67 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:34.486499 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a729cb95-d499-49de-95e6-62b09ea2ff67 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:34.494162 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a729cb95-d499-49de-95e6-62b09ea2ff67 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.494668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a729cb95-d499-49de-95e6-62b09ea2ff67 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.495081 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a729cb95-d499-49de-95e6-62b09ea2ff67 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.495777 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a729cb95-d499-49de-95e6-62b09ea2ff67 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.496253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a729cb95-d499-49de-95e6-62b09ea2ff67 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.496674 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a729cb95-d499-49de-95e6-62b09ea2ff67 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.587102 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-a729cb95-d499-49de-95e6-62b09ea2ff67 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lazy-loading 'services' on Instance uuid f768af80-7eb3-49d3-b572-5665427c78ef {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:34.598324 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:34.599704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:34.608457 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.608980 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.609656 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.610827 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.611318 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.617012 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.747687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:34.757775 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:34.762174 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:34.763967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-19d10d04-b536-45ea-b0cf-ee4be49c8600 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1722 microversion: 2.20 time: 0.170011 Aug 24 10:23:34.766549 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 398/791] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:34 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:34.942314 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a729cb95-d499-49de-95e6-62b09ea2ff67 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments/5e50a9c5-641a-4964-bfe6-d21728c3dfd4" status: 202 len: 0 microversion: 2.1 time: 0.460434 Aug 24 10:23:34.942935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 394/792] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:23:34 2022] DELETE /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments/5e50a9c5-641a-4964-bfe6-d21728c3dfd4 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:34.952950 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-88b3dd1d-1d81-400c-a29e-b5ad7f03c934 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:34.955537 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-88b3dd1d-1d81-400c-a29e-b5ad7f03c934 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:34.961911 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-88b3dd1d-1d81-400c-a29e-b5ad7f03c934 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.962396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-88b3dd1d-1d81-400c-a29e-b5ad7f03c934 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.962850 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-88b3dd1d-1d81-400c-a29e-b5ad7f03c934 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.963550 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-88b3dd1d-1d81-400c-a29e-b5ad7f03c934 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:34.963997 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-88b3dd1d-1d81-400c-a29e-b5ad7f03c934 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:34.964413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-88b3dd1d-1d81-400c-a29e-b5ad7f03c934 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:34.998201 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-88b3dd1d-1d81-400c-a29e-b5ad7f03c934 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049341 Aug 24 10:23:34.998892 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 399/793] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:23:34 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:35.792588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:35.793310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:35.800526 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:35.800896 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:35.801528 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:35.802222 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:35.802849 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:35.804489 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:35.942627 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:35.951668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:35.953286 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:35.954463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ad6fb4b9-db93-4176-b7b6-9389647cc615 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1722 microversion: 2.20 time: 0.166569 Aug 24 10:23:35.955020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 395/794] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:35 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:36.011179 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-76628b1b-fbf9-4b2e-abd9-5f7822f6323d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:36.013698 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-76628b1b-fbf9-4b2e-abd9-5f7822f6323d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:36.019854 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76628b1b-fbf9-4b2e-abd9-5f7822f6323d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:36.020338 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76628b1b-fbf9-4b2e-abd9-5f7822f6323d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:36.020773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76628b1b-fbf9-4b2e-abd9-5f7822f6323d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:36.021482 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76628b1b-fbf9-4b2e-abd9-5f7822f6323d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:36.022630 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76628b1b-fbf9-4b2e-abd9-5f7822f6323d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:36.023286 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-76628b1b-fbf9-4b2e-abd9-5f7822f6323d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:36.054931 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-76628b1b-fbf9-4b2e-abd9-5f7822f6323d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048462 Aug 24 10:23:36.055723 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 400/795] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:23:36 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:36.978629 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:36.979131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:36.987088 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:36.987607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:36.988036 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:36.988744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:36.989343 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:36.989792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:37.092672 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-40d0ad6f-810e-4200-a96a-ddfd6d2a6058 tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Action: 'create', calling method: .version_select at 0x7f0af4071d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1278678982", "metadata": {"Type": "work"}}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-40d0ad6f-810e-4200-a96a-ddfd6d2a6058 tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Request method failure captured: Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 122 Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfwofNM4bMoUUuEaKns624Z0AfHc79j37dF0meuMNb1BpeXXCCO2aCAgwDMw62U6gLTlB_VlqIIpX0DI_enKMy6AVR3lR_JEW3ZvE15QTDBw1Kzmg2baCP5WLFVY_YURmeIyiHr_kknQEFBbI_sdp44Uyy3enFc3yYdjDdqgLWCkq-U Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:37.104884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8acb53c7ce5e4866a5bef0e240216341", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: ddfe768a4b7643ce89d98ebfef9760a4 Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1278678982", "metadata": {"Type": "work"}}} Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: Aug 24 10:23:37.106278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1278678982', 'metadata': {'Type': 'work'}}}} Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:37.107265 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:23:37.108602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:23:37.109915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 10:23:37.109915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.109915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-40d0ad6f-810e-4200-a96a-ddfd6d2a6058 tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:37.109915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-40d0ad6f-810e-4200-a96a-ddfd6d2a6058 tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141383 Aug 24 10:23:37.109915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 396/796] 10.222.0.30 () {60 vars in 1156 bytes} [Wed Aug 24 10:23:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:23:37.116343 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a9f29aaa-b851-4e4d-a94e-3768481a3b6d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:37.121013 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a9f29aaa-b851-4e4d-a94e-3768481a3b6d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:37.126192 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a9f29aaa-b851-4e4d-a94e-3768481a3b6d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:37.126900 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a9f29aaa-b851-4e4d-a94e-3768481a3b6d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:37.127518 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a9f29aaa-b851-4e4d-a94e-3768481a3b6d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:37.128518 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a9f29aaa-b851-4e4d-a94e-3768481a3b6d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:37.129181 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a9f29aaa-b851-4e4d-a94e-3768481a3b6d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:37.129785 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a9f29aaa-b851-4e4d-a94e-3768481a3b6d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:37.130999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:37.135285 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:37.141656 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:37.143377 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:37.144563 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f61dd5e0-7c1e-4b03-9013-223da825231d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1722 microversion: 2.20 time: 0.170568 Aug 24 10:23:37.145178 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 401/797] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:36 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:37.150522 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-eda4314d-f589-43bf-a4a6-9fff96215f46 tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Action: 'create', calling method: .version_select at 0x7f0ae7fe3670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-604783073", "metadata": {"Type": "work"}}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-eda4314d-f589-43bf-a4a6-9fff96215f46 tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Request method failure captured: Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 119 Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfwofNM4bMoUUuEaKns624Z0AfHc79j37dF0meuMNb1BpeXXCCO2aCAgwDMw62U6gLTlB_VlqIIpX0DI_enKMy6AVR3lR_JEW3ZvE15QTDBw1Kzmg2baCP5WLFVY_YURmeIyiHr_kknQEFBbI_sdp44Uyy3enFc3yYdjDdqgLWCkq-U Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:23:37.155342 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8acb53c7ce5e4866a5bef0e240216341", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: ddfe768a4b7643ce89d98ebfef9760a4 Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-604783073", "metadata": {"Type": "work"}}} Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: Aug 24 10:23:37.156660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-604783073', 'metadata': {'Type': 'work'}}}} Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi '0' Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:37.157647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:23:37.158967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:23:37.160120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 10:23:37.160120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.160120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-eda4314d-f589-43bf-a4a6-9fff96215f46 tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:37.160120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-eda4314d-f589-43bf-a4a6-9fff96215f46 tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010461 Aug 24 10:23:37.160120 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 402/798] 10.222.0.30 () {60 vars in 1156 bytes} [Wed Aug 24 10:23:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:23:37.166807 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7b5c5515-cb03-49d8-93b5-e88489cdcbba tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Action: 'create', calling method: .version_select at 0x7f0ae7fa7670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-417709373", "metadata": {"Type": "work"}}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7b5c5515-cb03-49d8-93b5-e88489cdcbba tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Request method failure captured: Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 118 Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfwofNM4bMoUUuEaKns624Z0AfHc79j37dF0meuMNb1BpeXXCCO2aCAgwDMw62U6gLTlB_VlqIIpX0DI_enKMy6AVR3lR_JEW3ZvE15QTDBw1Kzmg2baCP5WLFVY_YURmeIyiHr_kknQEFBbI_sdp44Uyy3enFc3yYdjDdqgLWCkq-U Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:23:37.170598 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8acb53c7ce5e4866a5bef0e240216341", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: ddfe768a4b7643ce89d98ebfef9760a4 Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-417709373", "metadata": {"Type": "work"}}} Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: Aug 24 10:23:37.172173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-417709373', 'metadata': {'Type': 'work'}}}} Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise error Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi '' Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:37.173323 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 10:23:37.174705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 10:23:37.175825 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 10:23:37.175825 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.175825 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7b5c5515-cb03-49d8-93b5-e88489cdcbba tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:37.175825 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7b5c5515-cb03-49d8-93b5-e88489cdcbba tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009395 Aug 24 10:23:37.176842 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 403/799] 10.222.0.30 () {60 vars in 1156 bytes} [Wed Aug 24 10:23:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 10:23:37.180104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a9f29aaa-b851-4e4d-a94e-3768481a3b6d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071680 Aug 24 10:23:37.184125 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 397/800] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:23:37 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:37.184472 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6f16b778-1ff7-4afc-ba8c-ada9205b204a tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Calling method '.version_select at 0x7f0ae7fa7f70>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:37.213478 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-6f16b778-1ff7-4afc-ba8c-ada9205b204a tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] HTTP exception thrown: Volume tempest-invalid-528917950 could not be found. Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6f16b778-1ff7-4afc-ba8c-ada9205b204a tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Request method failure captured: Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-528917950 HTTP/1.1 Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfwofNM4bMoUUuEaKns624Z0AfHc79j37dF0meuMNb1BpeXXCCO2aCAgwDMw62U6gLTlB_VlqIIpX0DI_enKMy6AVR3lR_JEW3ZvE15QTDBw1Kzmg2baCP5WLFVY_YURmeIyiHr_kknQEFBbI_sdp44Uyy3enFc3yYdjDdqgLWCkq-U Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:23:37.215607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8acb53c7ce5e4866a5bef0e240216341", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: ddfe768a4b7643ce89d98ebfef9760a4 Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Volume tempest-invalid-528917950 could not be found. Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': 'tempest-invalid-528917950'} Aug 24 10:23:37.217247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-528917950 could not be found. (HTTP 404) (Request-ID: req-39dbb855-e1f1-4f59-b4b3-d027e258ffeb) Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:23:37.219381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-528917950 could not be found. Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:37.220481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-528917950 could not be found. Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-528917950 could not be found. Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6f16b778-1ff7-4afc-ba8c-ada9205b204a tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Returning 404 to user: Volume tempest-invalid-528917950 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-6f16b778-1ff7-4afc-ba8c-ada9205b204a tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-528917950" status: 404 len: 98 microversion: 2.1 time: 0.036377 Aug 24 10:23:37.221882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 404/801] 10.222.0.30 () {58 vars in 1215 bytes} [Wed Aug 24 10:23:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-528917950 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 10:23:37.227815 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ce46d7ef-06d8-485e-a6da-b0c878064d6b tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004622 Aug 24 10:23:37.228309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 398/802] 10.222.0.30 () {58 vars in 1140 bytes} [Wed Aug 24 10:23:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 10:23:37.237462 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-65a87c74-b3eb-47b7-84cb-6d42fe2cd0cb tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003993 Aug 24 10:23:37.238153 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 405/803] 10.222.0.30 () {58 vars in 1137 bytes} [Wed Aug 24 10:23:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 10:23:37.246258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1b40d41d-a6a0-40b9-9675-80bfa8313c5f tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Calling method '.version_select at 0x7f0af4147670>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:37.280046 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-1b40d41d-a6a0-40b9-9675-80bfa8313c5f tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] HTTP exception thrown: Volume f038bb43-e861-4023-915a-9f7fdfa26371 could not be found. Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1b40d41d-a6a0-40b9-9675-80bfa8313c5f tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Request method failure captured: Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: DELETE /compute/v2.1/os-volumes/f038bb43-e861-4023-915a-9f7fdfa26371 HTTP/1.1 Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfwofNM4bMoUUuEaKns624Z0AfHc79j37dF0meuMNb1BpeXXCCO2aCAgwDMw62U6gLTlB_VlqIIpX0DI_enKMy6AVR3lR_JEW3ZvE15QTDBw1Kzmg2baCP5WLFVY_YURmeIyiHr_kknQEFBbI_sdp44Uyy3enFc3yYdjDdqgLWCkq-U Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:37.282004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8acb53c7ce5e4866a5bef0e240216341", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: ddfe768a4b7643ce89d98ebfef9760a4 Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Volume f038bb43-e861-4023-915a-9f7fdfa26371 could not be found. Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': 'f038bb43-e861-4023-915a-9f7fdfa26371'} Aug 24 10:23:37.283540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f038bb43-e861-4023-915a-9f7fdfa26371 could not be found. (HTTP 404) (Request-ID: req-406fb7d7-37d4-46ec-8a9a-b146ac565792) Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.284631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:23:37.286019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f038bb43-e861-4023-915a-9f7fdfa26371 could not be found. Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 10:23:37.287336 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f038bb43-e861-4023-915a-9f7fdfa26371 could not be found. Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f038bb43-e861-4023-915a-9f7fdfa26371 could not be found. Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1b40d41d-a6a0-40b9-9675-80bfa8313c5f tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Returning 404 to user: Volume f038bb43-e861-4023-915a-9f7fdfa26371 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1b40d41d-a6a0-40b9-9675-80bfa8313c5f tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/f038bb43-e861-4023-915a-9f7fdfa26371" status: 404 len: 109 microversion: 2.1 time: 0.040765 Aug 24 10:23:37.288600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 399/804] 10.222.0.30 () {58 vars in 1248 bytes} [Wed Aug 24 10:23:37 2022] DELETE /compute/v2.1/os-volumes/f038bb43-e861-4023-915a-9f7fdfa26371 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:37.294686 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-eb193130-1499-46b4-a0cb-156f96ca73cb tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Calling method '.version_select at 0x7f0af404da60>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:37.324271 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-eb193130-1499-46b4-a0cb-156f96ca73cb tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] HTTP exception thrown: Volume 79148785-fee9-41f2-876c-7a13f37ce0d5 could not be found. Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-eb193130-1499-46b4-a0cb-156f96ca73cb tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Request method failure captured: Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/os-volumes/79148785-fee9-41f2-876c-7a13f37ce0d5 HTTP/1.1 Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfwofNM4bMoUUuEaKns624Z0AfHc79j37dF0meuMNb1BpeXXCCO2aCAgwDMw62U6gLTlB_VlqIIpX0DI_enKMy6AVR3lR_JEW3ZvE15QTDBw1Kzmg2baCP5WLFVY_YURmeIyiHr_kknQEFBbI_sdp44Uyy3enFc3yYdjDdqgLWCkq-U Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:23:37.326251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8acb53c7ce5e4866a5bef0e240216341", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8acb53c7ce5e4866a5bef0e240216341"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8acb53c7ce5e4866a5bef0e240216341 Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-VolumesNegativeTest-361529208 Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: ddfe768a4b7643ce89d98ebfef9760a4 Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-VolumesNegativeTest-361529208-project Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Volume 79148785-fee9-41f2-876c-7a13f37ce0d5 could not be found. Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '79148785-fee9-41f2-876c-7a13f37ce0d5'} Aug 24 10:23:37.327580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79148785-fee9-41f2-876c-7a13f37ce0d5 could not be found. (HTTP 404) (Request-ID: req-181e8ee1-918b-44ec-9aad-6d8acc7c11c3) Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.329052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:23:37.330545 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79148785-fee9-41f2-876c-7a13f37ce0d5 could not be found. Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 10:23:37.331719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79148785-fee9-41f2-876c-7a13f37ce0d5 could not be found. Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79148785-fee9-41f2-876c-7a13f37ce0d5 could not be found. Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-eb193130-1499-46b4-a0cb-156f96ca73cb tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] Returning 404 to user: Volume 79148785-fee9-41f2-876c-7a13f37ce0d5 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-eb193130-1499-46b4-a0cb-156f96ca73cb tempest-VolumesNegativeTest-361529208 tempest-VolumesNegativeTest-361529208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/79148785-fee9-41f2-876c-7a13f37ce0d5" status: 404 len: 109 microversion: 2.1 time: 0.037083 Aug 24 10:23:37.332962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 406/805] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:23:37 2022] GET /compute/v2.1/os-volumes/79148785-fee9-41f2-876c-7a13f37ce0d5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:38.136642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-664a8376-4f52-4cd5-9a73-f6b110bae7db req-c009d289-4e97-49f8-80ae-8a92e97f0e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246f3e69-c7bf-462e-88a0-e209d93b5603", "name": "network-vif-unplugged", "status": "completed", "tag": "a92e393c-0dd2-4ec0-8147-c860a2c195f8"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:38.147359 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-664a8376-4f52-4cd5-9a73-f6b110bae7db req-c009d289-4e97-49f8-80ae-8a92e97f0e49 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.147873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-664a8376-4f52-4cd5-9a73-f6b110bae7db req-c009d289-4e97-49f8-80ae-8a92e97f0e49 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.148304 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-664a8376-4f52-4cd5-9a73-f6b110bae7db req-c009d289-4e97-49f8-80ae-8a92e97f0e49 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.158612 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.compute.server_external_events [req-664a8376-4f52-4cd5-9a73-f6b110bae7db req-c009d289-4e97-49f8-80ae-8a92e97f0e49 service nova] Unable to find a host for instance 246f3e69-c7bf-462e-88a0-e209d93b5603. Dropping event network-vif-unplugged {{(pid=121270) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 10:23:38.159505 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-664a8376-4f52-4cd5-9a73-f6b110bae7db req-c009d289-4e97-49f8-80ae-8a92e97f0e49 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028385 Aug 24 10:23:38.160072 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 400/806] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 10:23:38.173080 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:38.173720 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:38.180771 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.181277 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.181712 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.182407 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.182856 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.183277 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.194356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8bdbd11d-3244-4c3b-a79f-7a438aa6c4cc tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:38.196550 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8bdbd11d-3244-4c3b-a79f-7a438aa6c4cc tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:38.202491 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8bdbd11d-3244-4c3b-a79f-7a438aa6c4cc tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.202975 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8bdbd11d-3244-4c3b-a79f-7a438aa6c4cc tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.203408 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8bdbd11d-3244-4c3b-a79f-7a438aa6c4cc tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.204151 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8bdbd11d-3244-4c3b-a79f-7a438aa6c4cc tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.204606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8bdbd11d-3244-4c3b-a79f-7a438aa6c4cc tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.205137 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8bdbd11d-3244-4c3b-a79f-7a438aa6c4cc tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.240514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8bdbd11d-3244-4c3b-a79f-7a438aa6c4cc tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048168 Aug 24 10:23:38.243691 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 401/807] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:23:38 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 10:23:38.353762 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:38.371342 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-82615b17-44d5-4fd8-a73e-7477281cac99 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:38.371939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-82615b17-44d5-4fd8-a73e-7477281cac99 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:38.378061 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:38.378858 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82615b17-44d5-4fd8-a73e-7477281cac99 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.379613 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:38.380135 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82615b17-44d5-4fd8-a73e-7477281cac99 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.380730 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82615b17-44d5-4fd8-a73e-7477281cac99 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.380852 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-487794cb-58a4-474b-a8d4-e1cec04dd6d6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1665 microversion: 2.20 time: 0.212248 Aug 24 10:23:38.381558 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 407/808] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:38 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1665 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:38.381915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82615b17-44d5-4fd8-a73e-7477281cac99 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.382610 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82615b17-44d5-4fd8-a73e-7477281cac99 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.383174 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82615b17-44d5-4fd8-a73e-7477281cac99 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.424469 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-82615b17-44d5-4fd8-a73e-7477281cac99 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Going to try to terminate instance {{(pid=121270) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:38.427355 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-715b45b0-420b-45b3-bcd9-e93c05c0042c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9deaf573-72ca-48a8-ad36-e80eafbadfcf"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:38.431389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-715b45b0-420b-45b3-bcd9-e93c05c0042c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:38.438903 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-715b45b0-420b-45b3-bcd9-e93c05c0042c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.439532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-715b45b0-420b-45b3-bcd9-e93c05c0042c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.440273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-715b45b0-420b-45b3-bcd9-e93c05c0042c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.441307 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-715b45b0-420b-45b3-bcd9-e93c05c0042c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.442038 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-715b45b0-420b-45b3-bcd9-e93c05c0042c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.442784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-715b45b0-420b-45b3-bcd9-e93c05c0042c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.903908 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-82615b17-44d5-4fd8-a73e-7477281cac99 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 204 len: 0 microversion: 2.1 time: 0.539024 Aug 24 10:23:38.906357 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 402/809] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:38 2022] DELETE /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:23:38.917960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9b2c58b9-961b-4f93-a7ac-db7b99ba4e35 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:38.918488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9b2c58b9-961b-4f93-a7ac-db7b99ba4e35 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:38.930465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b2c58b9-961b-4f93-a7ac-db7b99ba4e35 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.930953 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b2c58b9-961b-4f93-a7ac-db7b99ba4e35 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.931385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b2c58b9-961b-4f93-a7ac-db7b99ba4e35 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:38.932260 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b2c58b9-961b-4f93-a7ac-db7b99ba4e35 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:38.932705 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b2c58b9-961b-4f93-a7ac-db7b99ba4e35 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:38.933148 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9b2c58b9-961b-4f93-a7ac-db7b99ba4e35 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:39.088226 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9b2c58b9-961b-4f93-a7ac-db7b99ba4e35 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:39.093736 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9b2c58b9-961b-4f93-a7ac-db7b99ba4e35 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1681 microversion: 2.1 time: 0.179995 Aug 24 10:23:39.105296 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 403/810] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:38 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:39.140273 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-05506843-a98d-476f-b3dd-3d22ea20f681 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:39.140954 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-05506843-a98d-476f-b3dd-3d22ea20f681 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:39.152112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:39.157607 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-05506843-a98d-476f-b3dd-3d22ea20f681 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:39.158035 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-05506843-a98d-476f-b3dd-3d22ea20f681 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:39.158465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-05506843-a98d-476f-b3dd-3d22ea20f681 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:39.159169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-05506843-a98d-476f-b3dd-3d22ea20f681 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:39.159616 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-05506843-a98d-476f-b3dd-3d22ea20f681 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:39.160040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-05506843-a98d-476f-b3dd-3d22ea20f681 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:39.183394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-05506843-a98d-476f-b3dd-3d22ea20f681 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lazy-loading 'flavor' on Instance uuid d352ff4a-5771-4d5d-a56c-9708b7e68182 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:39.542890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-05506843-a98d-476f-b3dd-3d22ea20f681 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "POST /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182/action" status: 202 len: 0 microversion: 2.1 time: 0.406882 Aug 24 10:23:39.549928 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 404/811] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:23:39 2022] POST /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:23:39.556192 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-be9a6e6c-d6af-45c1-ba30-0a93c4212e63 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:39.556921 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-be9a6e6c-d6af-45c1-ba30-0a93c4212e63 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:39.564174 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be9a6e6c-d6af-45c1-ba30-0a93c4212e63 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:39.567740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be9a6e6c-d6af-45c1-ba30-0a93c4212e63 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:39.567740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be9a6e6c-d6af-45c1-ba30-0a93c4212e63 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:39.567740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be9a6e6c-d6af-45c1-ba30-0a93c4212e63 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:39.567740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be9a6e6c-d6af-45c1-ba30-0a93c4212e63 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:39.568373 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-be9a6e6c-d6af-45c1-ba30-0a93c4212e63 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:39.704655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-be9a6e6c-d6af-45c1-ba30-0a93c4212e63 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:39.713254 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-be9a6e6c-d6af-45c1-ba30-0a93c4212e63 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.162064 Aug 24 10:23:39.713818 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 405/812] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:39 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:39.869456 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-715b45b0-420b-45b3-bcd9-e93c05c0042c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "POST /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.447601 Aug 24 10:23:39.875261 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 408/813] 10.222.0.30 () {62 vars in 1364 bytes} [Wed Aug 24 10:23:38 2022] POST /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/os-volume_attachments => generated 188 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 10:23:40.004000 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3b076584-1dd0-4afe-a765-9f73daac93b8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:40.004590 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3b076584-1dd0-4afe-a765-9f73daac93b8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:40.011105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b076584-1dd0-4afe-a765-9f73daac93b8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.011656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b076584-1dd0-4afe-a765-9f73daac93b8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.012230 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b076584-1dd0-4afe-a765-9f73daac93b8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.012970 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b076584-1dd0-4afe-a765-9f73daac93b8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.013418 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b076584-1dd0-4afe-a765-9f73daac93b8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.013830 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3b076584-1dd0-4afe-a765-9f73daac93b8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.118766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-53c36aac-e5f2-4274-8f33-9a87bdff537a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:40.119417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-53c36aac-e5f2-4274-8f33-9a87bdff537a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:40.126010 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-53c36aac-e5f2-4274-8f33-9a87bdff537a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.131599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-53c36aac-e5f2-4274-8f33-9a87bdff537a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.131599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-53c36aac-e5f2-4274-8f33-9a87bdff537a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.131599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-53c36aac-e5f2-4274-8f33-9a87bdff537a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.131599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-53c36aac-e5f2-4274-8f33-9a87bdff537a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.131984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-53c36aac-e5f2-4274-8f33-9a87bdff537a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.271068 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-53c36aac-e5f2-4274-8f33-9a87bdff537a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:40.279564 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-53c36aac-e5f2-4274-8f33-9a87bdff537a tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1681 microversion: 2.1 time: 0.165357 Aug 24 10:23:40.280147 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 409/814] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:40 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:40.736434 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-16b604ac-311d-4c4d-99c9-bf2b54b72343 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:40.736648 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3b076584-1dd0-4afe-a765-9f73daac93b8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/os-volume_attachments/9deaf573-72ca-48a8-ad36-e80eafbadfcf" status: 202 len: 0 microversion: 2.20 time: 0.736531 Aug 24 10:23:40.737553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 406/815] 10.222.0.30 () {60 vars in 1457 bytes} [Wed Aug 24 10:23:39 2022] DELETE /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/os-volume_attachments/9deaf573-72ca-48a8-ad36-e80eafbadfcf => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:40.737686 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-16b604ac-311d-4c4d-99c9-bf2b54b72343 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:40.745193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16b604ac-311d-4c4d-99c9-bf2b54b72343 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.745896 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16b604ac-311d-4c4d-99c9-bf2b54b72343 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.747259 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16b604ac-311d-4c4d-99c9-bf2b54b72343 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.748181 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16b604ac-311d-4c4d-99c9-bf2b54b72343 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.748975 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16b604ac-311d-4c4d-99c9-bf2b54b72343 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.749601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16b604ac-311d-4c4d-99c9-bf2b54b72343 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.826224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0d8fd48a-7a41-48a0-9c86-a04617368abe tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:40.826858 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0d8fd48a-7a41-48a0-9c86-a04617368abe tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:40.835384 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d8fd48a-7a41-48a0-9c86-a04617368abe tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.841209 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d8fd48a-7a41-48a0-9c86-a04617368abe tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.842593 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d8fd48a-7a41-48a0-9c86-a04617368abe tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.843338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d8fd48a-7a41-48a0-9c86-a04617368abe tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:40.843972 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d8fd48a-7a41-48a0-9c86-a04617368abe tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:40.844403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d8fd48a-7a41-48a0-9c86-a04617368abe tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:40.907603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0d8fd48a-7a41-48a0-9c86-a04617368abe tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121270) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 10:23:40.929156 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-16b604ac-311d-4c4d-99c9-bf2b54b72343 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:40.939894 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-16b604ac-311d-4c4d-99c9-bf2b54b72343 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.208637 Aug 24 10:23:40.940995 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 410/816] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:40 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:41.302491 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-36f8e4bb-b43b-4af4-b091-16edf174c7fe tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:41.303944 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-36f8e4bb-b43b-4af4-b091-16edf174c7fe tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:41.310393 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36f8e4bb-b43b-4af4-b091-16edf174c7fe tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.310886 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36f8e4bb-b43b-4af4-b091-16edf174c7fe tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.312336 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36f8e4bb-b43b-4af4-b091-16edf174c7fe tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.312336 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36f8e4bb-b43b-4af4-b091-16edf174c7fe tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.312506 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36f8e4bb-b43b-4af4-b091-16edf174c7fe tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.312849 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36f8e4bb-b43b-4af4-b091-16edf174c7fe tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.452763 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-36f8e4bb-b43b-4af4-b091-16edf174c7fe tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:41.461611 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-36f8e4bb-b43b-4af4-b091-16edf174c7fe tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1681 microversion: 2.1 time: 0.163293 Aug 24 10:23:41.462584 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 411/817] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:41 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:41.558730 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0d8fd48a-7a41-48a0-9c86-a04617368abe tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "POST /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/action" status: 202 len: 0 microversion: 2.20 time: 0.737828 Aug 24 10:23:41.562646 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 407/818] 10.222.0.30 () {62 vars in 1319 bytes} [Wed Aug 24 10:23:40 2022] POST /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:23:41.567889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:41.569538 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:41.577499 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.578169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.578744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.579450 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.580053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.580498 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.741443 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:41.770265 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:41.774431 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:41.776908 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-fbc4a881-cc85-4732-89ad-9fe71e699e90 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1673 microversion: 2.20 time: 0.212464 Aug 24 10:23:41.787987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 412/819] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:41 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:41.964228 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-effe9933-a1a4-4281-927e-019f210c4713 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:41.975147 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-effe9933-a1a4-4281-927e-019f210c4713 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:41.975147 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-effe9933-a1a4-4281-927e-019f210c4713 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.975147 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-effe9933-a1a4-4281-927e-019f210c4713 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.975147 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-effe9933-a1a4-4281-927e-019f210c4713 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:41.975500 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-effe9933-a1a4-4281-927e-019f210c4713 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:41.975500 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-effe9933-a1a4-4281-927e-019f210c4713 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:41.975500 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-effe9933-a1a4-4281-927e-019f210c4713 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.434442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-6530ae68-0697-4de7-919c-6f468f975ae6 req-cbe86292-d56c-44ec-b299-09666cda61c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f768af80-7eb3-49d3-b572-5665427c78ef", "name": "network-vif-deleted", "tag": "d1dc3025-0942-4668-8591-d4a8783a2107"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:42.441274 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-effe9933-a1a4-4281-927e-019f210c4713 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:42.455396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-6530ae68-0697-4de7-919c-6f468f975ae6 req-cbe86292-d56c-44ec-b299-09666cda61c9 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.456475 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-6530ae68-0697-4de7-919c-6f468f975ae6 req-cbe86292-d56c-44ec-b299-09666cda61c9 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.456475 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-6530ae68-0697-4de7-919c-6f468f975ae6 req-cbe86292-d56c-44ec-b299-09666cda61c9 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.456808 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-effe9933-a1a4-4281-927e-019f210c4713 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.496071 Aug 24 10:23:42.468896 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 408/820] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:41 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:42.472981 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-6530ae68-0697-4de7-919c-6f468f975ae6 req-cbe86292-d56c-44ec-b299-09666cda61c9 service nova] Creating event network-vif-deleted:d1dc3025-0942-4668-8591-d4a8783a2107 for instance f768af80-7eb3-49d3-b572-5665427c78ef on hv-cinder-85427 Aug 24 10:23:42.485925 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-33f9726f-258b-4719-a018-415a8c3d8f62 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:42.486698 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-33f9726f-258b-4719-a018-415a8c3d8f62 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:42.495913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-6530ae68-0697-4de7-919c-6f468f975ae6 req-cbe86292-d56c-44ec-b299-09666cda61c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066233 Aug 24 10:23:42.496699 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 413/821] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:42.501187 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33f9726f-258b-4719-a018-415a8c3d8f62 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.501884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33f9726f-258b-4719-a018-415a8c3d8f62 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.502508 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33f9726f-258b-4719-a018-415a8c3d8f62 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.503404 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33f9726f-258b-4719-a018-415a8c3d8f62 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.504204 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33f9726f-258b-4719-a018-415a8c3d8f62 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.504794 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-33f9726f-258b-4719-a018-415a8c3d8f62 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.528619 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=8,nova_cell1:INSERT=5 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:42.585034 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-33f9726f-258b-4719-a018-415a8c3d8f62 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:42.594642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-33f9726f-258b-4719-a018-415a8c3d8f62 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1613 microversion: 2.1 time: 0.113273 Aug 24 10:23:42.594642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 409/822] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:42 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:42.811667 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:42.812392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:42.820525 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.821056 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.830363 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:42.830363 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:42.830363 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:42.830363 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.022848 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:43.031227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:43.033051 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:43.034163 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-cdd6a3c1-e1bb-403c-89d1-f92029e063f5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1673 microversion: 2.20 time: 0.227149 Aug 24 10:23:43.034732 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 414/823] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:42 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:43.479938 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c4fc3684-cba0-4eec-8aae-07332c3a5098 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:43.480544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c4fc3684-cba0-4eec-8aae-07332c3a5098 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:43.492409 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4fc3684-cba0-4eec-8aae-07332c3a5098 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.493017 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4fc3684-cba0-4eec-8aae-07332c3a5098 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.493225 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4fc3684-cba0-4eec-8aae-07332c3a5098 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.493974 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4fc3684-cba0-4eec-8aae-07332c3a5098 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.494429 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4fc3684-cba0-4eec-8aae-07332c3a5098 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.494847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c4fc3684-cba0-4eec-8aae-07332c3a5098 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.616306 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:43.616957 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:43.626221 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.635428 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.636167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.637126 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.638250 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.638885 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.706172 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:43.706921 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:43.707658 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:43.708096 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lazy-loading 'fault' on Instance uuid f768af80-7eb3-49d3-b572-5665427c78ef {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:43.736800 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c4fc3684-cba0-4eec-8aae-07332c3a5098 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:43.746820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c4fc3684-cba0-4eec-8aae-07332c3a5098 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.270602 Aug 24 10:23:43.747407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 410/824] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:43 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:43.767835 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c94c65ae14e94796a3b3bd0bb29a91b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824664cdd104c308141264985a547a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:43.778460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-34cd3387-44ed-4d10-ab90-370ffb56f618 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 200 len: 1331 microversion: 2.1 time: 0.166285 Aug 24 10:23:43.779080 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 415/825] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:43 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:44.059208 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:44.059814 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:44.065905 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:44.066387 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:44.066941 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:44.067678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:44.074779 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:44.074779 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:44.214673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:44.222678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:44.224166 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:44.225981 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-fe8c925a-85fd-4cc2-8041-5062022aebb8 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.170769 Aug 24 10:23:44.226534 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 411/826] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:44 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:44.769426 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d1a7082a-5c7c-4a8b-8b45-0f4287757d84 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:44.770051 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d1a7082a-5c7c-4a8b-8b45-0f4287757d84 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:44.779456 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1a7082a-5c7c-4a8b-8b45-0f4287757d84 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:44.780387 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1a7082a-5c7c-4a8b-8b45-0f4287757d84 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:44.781635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1a7082a-5c7c-4a8b-8b45-0f4287757d84 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:44.782511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1a7082a-5c7c-4a8b-8b45-0f4287757d84 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:44.783415 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1a7082a-5c7c-4a8b-8b45-0f4287757d84 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:44.783994 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d1a7082a-5c7c-4a8b-8b45-0f4287757d84 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:44.804433 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:44.804978 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:44.815412 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:44.815899 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:44.816335 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:44.817061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:44.817512 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:44.817928 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:44.852227 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef HTTP/1.1 Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:44.853963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:44.855547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': 'f768af80-7eb3-49d3-b572-5665427c78ef'} Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:44.856451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:44.857889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:44.859914 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:44.861216 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d706a761-fd1e-4b18-a6ce-a38bd413ec36 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 404 len: 111 microversion: 2.1 time: 0.061926 Aug 24 10:23:44.862239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 412/827] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:44 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:44.873488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7b5bfd60-4915-4aa5-8bcb-5ebae236d729 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '.version_select at 0x7f0ae7fa0e50>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:44.955957 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d1a7082a-5c7c-4a8b-8b45-0f4287757d84 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:44.967999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d1a7082a-5c7c-4a8b-8b45-0f4287757d84 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.203893 Aug 24 10:23:44.968881 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 416/828] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:44 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:45.012733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7b5bfd60-4915-4aa5-8bcb-5ebae236d729 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-784523870" status: 202 len: 0 microversion: 2.1 time: 0.144429 Aug 24 10:23:45.013952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 413/829] 10.222.0.30 () {58 vars in 1218 bytes} [Wed Aug 24 10:23:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-784523870 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:23:45.249474 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:45.256605 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:45.256605 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:45.269365 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:45.269942 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:45.270473 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:45.271266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:45.271862 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:45.272949 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:45.457698 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:45.472488 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:45.474061 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:45.477207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a2f165a8-901e-4a62-a10e-7b572dee31db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.231432 Aug 24 10:23:45.477982 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 417/830] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:45 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:45.996119 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d2c437db-258d-49df-a92d-3e99481f0b7d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:45.996883 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d2c437db-258d-49df-a92d-3e99481f0b7d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:46.005562 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d2c437db-258d-49df-a92d-3e99481f0b7d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:46.006463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d2c437db-258d-49df-a92d-3e99481f0b7d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:46.007775 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d2c437db-258d-49df-a92d-3e99481f0b7d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:46.008721 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d2c437db-258d-49df-a92d-3e99481f0b7d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:46.009396 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d2c437db-258d-49df-a92d-3e99481f0b7d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:46.010142 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d2c437db-258d-49df-a92d-3e99481f0b7d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:46.183020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d2c437db-258d-49df-a92d-3e99481f0b7d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:46.199438 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d2c437db-258d-49df-a92d-3e99481f0b7d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.207896 Aug 24 10:23:46.201033 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 414/831] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:45 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:46.500499 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:46.501913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:46.509307 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:46.510196 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:46.510627 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:46.511337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:46.511790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:46.518201 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:46.734150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:46.750540 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:46.755601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:46.763559 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d6391a9e-3056-4407-ab1b-3fd84e58def7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.267341 Aug 24 10:23:46.784615 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 418/832] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:46 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:47.225832 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7e9b6118-6a04-4b5b-8744-15de37c1f257 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:47.234620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7e9b6118-6a04-4b5b-8744-15de37c1f257 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:47.253118 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e9b6118-6a04-4b5b-8744-15de37c1f257 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.253625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e9b6118-6a04-4b5b-8744-15de37c1f257 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.254056 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e9b6118-6a04-4b5b-8744-15de37c1f257 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.254763 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e9b6118-6a04-4b5b-8744-15de37c1f257 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.255214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e9b6118-6a04-4b5b-8744-15de37c1f257 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.255642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e9b6118-6a04-4b5b-8744-15de37c1f257 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.423887 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:47.424648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:47.440252 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.445988 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.446849 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.447657 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.448136 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.448576 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.490675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7e9b6118-6a04-4b5b-8744-15de37c1f257 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:47.491837 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: DELETE /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef HTTP/1.1 Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:23:47.495477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:47.497232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': 'f768af80-7eb3-49d3-b572-5665427c78ef'} Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:47.498142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:47.499679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:47.501857 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:47.501857 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-58ec2695-87c8-4d00-8f5a-968fb304fceb tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 404 len: 111 microversion: 2.1 time: 0.078387 Aug 24 10:23:47.504121 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 419/833] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:47 2022] DELETE /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:23:47.506818 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7e9b6118-6a04-4b5b-8744-15de37c1f257 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.288172 Aug 24 10:23:47.507825 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 415/834] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:47 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:47.516032 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:47.519566 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: f768af80-7eb3-49d3-b572-5665427c78ef] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:47.524737 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.525273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.525852 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.526614 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.527064 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.527599 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.554334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef HTTP/1.1 Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:23:47.556148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:47.567993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': 'f768af80-7eb3-49d3-b572-5665427c78ef'} Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:47.568916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. Aug 24 10:23:47.570314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:47.571617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance f768af80-7eb3-49d3-b572-5665427c78ef could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:47.571617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-aa67f58d-05f6-47ce-a9e5-41d03cd5221d tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef" status: 404 len: 111 microversion: 2.1 time: 0.051401 Aug 24 10:23:47.571617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 420/835] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:47 2022] GET /compute/v2.1/servers/f768af80-7eb3-49d3-b572-5665427c78ef => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:47.799244 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:47.799998 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:47.812231 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.812990 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.816073 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:47.818758 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:47.818758 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:47.818758 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.039514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:48.051887 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:48.054244 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:48.056025 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-98eaf49a-3340-4442-89c1-76e7dc0a6995 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.271268 Aug 24 10:23:48.070041 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 416/836] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:47 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:48.545484 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d7e2c824-8f25-4a84-ab35-398007661af9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:48.547628 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d7e2c824-8f25-4a84-ab35-398007661af9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:48.556124 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d7e2c824-8f25-4a84-ab35-398007661af9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.556940 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d7e2c824-8f25-4a84-ab35-398007661af9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.557636 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d7e2c824-8f25-4a84-ab35-398007661af9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.558747 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d7e2c824-8f25-4a84-ab35-398007661af9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.559587 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d7e2c824-8f25-4a84-ab35-398007661af9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.560233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d7e2c824-8f25-4a84-ab35-398007661af9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.788416 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d7e2c824-8f25-4a84-ab35-398007661af9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:48.801595 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d7e2c824-8f25-4a84-ab35-398007661af9 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.265204 Aug 24 10:23:48.819646 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 421/837] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:48 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:23:48.944535 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:48.945191 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:48.952059 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.952593 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.958637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.958637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:48.958637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:48.958637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:48.970092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: DELETE /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 HTTP/1.1 Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:48.972104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:23:48.973673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': 'cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1'} Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:48.974569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:23:48.976571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:48.978971 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:48.980096 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f051f4bc-e89e-4d5e-a92c-673203995ea5 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 404 len: 111 microversion: 2.1 time: 0.039482 Aug 24 10:23:48.981284 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 417/838] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:48 2022] DELETE /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:48.993055 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:48.996145 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:49.003694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.004182 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.004619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.005451 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.005908 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.006371 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.024211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 HTTP/1.1 Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:23:49.026533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:23:49.033914 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': 'cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1'} Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:49.034746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. Aug 24 10:23:49.035918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.039065 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:49.039065 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-30b40d61-41d9-4609-858e-df4cd0f6c40f tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1" status: 404 len: 111 microversion: 2.1 time: 0.043079 Aug 24 10:23:49.039065 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 422/839] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:48 2022] GET /compute/v2.1/servers/cc5597b6-0dd1-4d75-b1ef-29e0ea0608d1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:49.039515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:49.039515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:49.049971 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.050781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.051221 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.051936 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.052389 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.052810 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.078970 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: DELETE /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a HTTP/1.1 Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:49.083586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:23:49.085864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '4a33b6e4-dee4-4e74-9125-2023095d167a'} Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:49.086626 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:23:49.087837 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.089905 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:49.090103 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:49.090322 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:49.090470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8776de37-1149-4995-a82e-a99df38360b1 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 404 len: 111 microversion: 2.1 time: 0.049001 Aug 24 10:23:49.090788 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 418/840] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:49 2022] DELETE /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:23:49.096219 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:49.097184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 4a33b6e4-dee4-4e74-9125-2023095d167a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:49.097663 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.099563 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.100063 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.103941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.104503 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.105203 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.105710 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.106543 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.107209 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.108282 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.108969 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.109742 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.140007 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a HTTP/1.1 Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:49.143074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:23:49.149872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '4a33b6e4-dee4-4e74-9125-2023095d167a'} Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:49.150606 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. Aug 24 10:23:49.151877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:49.153494 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance 4a33b6e4-dee4-4e74-9125-2023095d167a could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:49.153494 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c26e39c2-cb5f-42eb-a8e7-98355de49809 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a" status: 404 len: 111 microversion: 2.1 time: 0.052826 Aug 24 10:23:49.153494 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 419/841] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:49 2022] GET /compute/v2.1/servers/4a33b6e4-dee4-4e74-9125-2023095d167a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:49.307292 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:49.317154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:49.318892 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:49.320823 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-01271381-856f-4c9f-b61b-ef710a259aac tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.245174 Aug 24 10:23:49.322053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 423/842] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:49 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:49.827585 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5f963b56-3d33-47e1-b6c5-86b54d07c166 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:49.828508 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5f963b56-3d33-47e1-b6c5-86b54d07c166 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:49.835105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f963b56-3d33-47e1-b6c5-86b54d07c166 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.835873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f963b56-3d33-47e1-b6c5-86b54d07c166 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.836316 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f963b56-3d33-47e1-b6c5-86b54d07c166 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:49.837047 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f963b56-3d33-47e1-b6c5-86b54d07c166 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:49.837501 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f963b56-3d33-47e1-b6c5-86b54d07c166 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:49.837923 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5f963b56-3d33-47e1-b6c5-86b54d07c166 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.109963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5f963b56-3d33-47e1-b6c5-86b54d07c166 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:50.120940 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5f963b56-3d33-47e1-b6c5-86b54d07c166 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.297187 Aug 24 10:23:50.121879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 420/843] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:49 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:50.354031 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:50.355410 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:50.366480 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.367318 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.368037 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.369294 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.369978 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.370819 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.526154 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:50.527160 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:50.534772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.535371 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.535768 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.536688 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.537869 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.537869 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.553164 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: DELETE /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af HTTP/1.1 Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:50.555781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:23:50.559793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '3bf8b275-61d0-49c9-8d08-c9aba96f38af'} Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:50.560741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:23:50.562206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:50.563458 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:50.563458 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-86c736cc-7b00-4df0-942c-81ea0a3ea7f7 tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 404 len: 111 microversion: 2.1 time: 0.037416 Aug 24 10:23:50.563458 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 421/844] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:50 2022] DELETE /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:23:50.564482 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:50.568392 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:50.570288 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] [instance: 3bf8b275-61d0-49c9-8d08-c9aba96f38af] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:50.576372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.576892 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.577327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.578024 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:50.578477 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:50.578899 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:50.583632 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:50.586137 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:50.587061 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3736e6ec-02b6-4a73-9e3f-30733da675ea tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.238190 Aug 24 10:23:50.596060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] HTTP exception thrown: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Request method failure captured: Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af HTTP/1.1 Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfqhzf3N8oJFvnxfa5MZgRqWqszQShuZYH1VQ0BkbLPE8OTiOqIt91o-VHT2kqFrVVgEa6BbQmWsIs6TlMoHNRyrOzzQ9N0V_JLHIbB2Qj2TJySODoFmd9kPATCEU_Fmeue2IHsJD7ad-zGHLzl0_kgVOoMPJFL4LPOBlaPc-839Gxg Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:23:50.598465 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8824664cdd104c308141264985a547a1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8824664cdd104c308141264985a547a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8824664cdd104c308141264985a547a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8824664cdd104c308141264985a547a1 Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-784789467 Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c94c65ae14e94796a3b3bd0bb29a91b9 Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeNegativeTest-784789467-project Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:23:50.599764 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '3bf8b275-61d0-49c9-8d08-c9aba96f38af'} Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:50.600603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. Aug 24 10:23:50.602544 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:23:50.604790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 424/845] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:50 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:50.605017 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] Returning 404 to user: Instance 3bf8b275-61d0-49c9-8d08-c9aba96f38af could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:50.605230 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2385e056-01a0-4939-8e9c-13fe12684dad tempest-AttachVolumeNegativeTest-784789467 tempest-AttachVolumeNegativeTest-784789467-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af" status: 404 len: 111 microversion: 2.1 time: 0.041826 Aug 24 10:23:50.606090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 422/846] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:50 2022] GET /compute/v2.1/servers/3bf8b275-61d0-49c9-8d08-c9aba96f38af => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:51.144117 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9d5e13d5-6c18-432e-83b2-7e0bbddea7db tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:51.145164 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9d5e13d5-6c18-432e-83b2-7e0bbddea7db tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:51.152815 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d5e13d5-6c18-432e-83b2-7e0bbddea7db tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:51.153638 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d5e13d5-6c18-432e-83b2-7e0bbddea7db tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:51.154294 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d5e13d5-6c18-432e-83b2-7e0bbddea7db tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:51.155265 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d5e13d5-6c18-432e-83b2-7e0bbddea7db tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:51.155920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d5e13d5-6c18-432e-83b2-7e0bbddea7db tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:51.156746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d5e13d5-6c18-432e-83b2-7e0bbddea7db tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:51.408766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9d5e13d5-6c18-432e-83b2-7e0bbddea7db tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:51.419982 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9d5e13d5-6c18-432e-83b2-7e0bbddea7db tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.279049 Aug 24 10:23:51.421804 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 425/847] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:51 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:51.611331 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:51.612569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:51.624889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:51.625655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:51.626289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:51.632679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:51.633550 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:51.634163 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:52.185367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:52.203068 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:52.210960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:52.222066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f151a9fa-168c-4ac9-bc14-bdb540dbd7eb tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.606221 Aug 24 10:23:52.222066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 423/848] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:51 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:52.443985 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b6bf1497-8bef-41d3-987c-945874fb1c13 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:52.446173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b6bf1497-8bef-41d3-987c-945874fb1c13 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:52.457354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6bf1497-8bef-41d3-987c-945874fb1c13 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:52.458084 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6bf1497-8bef-41d3-987c-945874fb1c13 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:52.460986 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6bf1497-8bef-41d3-987c-945874fb1c13 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:52.462064 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6bf1497-8bef-41d3-987c-945874fb1c13 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:52.462528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6bf1497-8bef-41d3-987c-945874fb1c13 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:52.462962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b6bf1497-8bef-41d3-987c-945874fb1c13 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:52.469808 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:52.645216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b6bf1497-8bef-41d3-987c-945874fb1c13 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:52.658123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b6bf1497-8bef-41d3-987c-945874fb1c13 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.218109 Aug 24 10:23:52.659325 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 426/849] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:52 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:53.240515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:53.242565 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:53.259155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.261353 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.262014 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.269437 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.270024 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.270464 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.637223 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:53.737102 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:53.737102 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:53.737102 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4e58036e-59ff-44e3-bc41-2d40f91a0f83 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.431940 Aug 24 10:23:53.737575 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 424/850] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:53 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:53.737660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-08929f5a-d8d7-436a-aff0-5d43bf21f23d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:53.737660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-08929f5a-d8d7-436a-aff0-5d43bf21f23d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:53.737660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08929f5a-d8d7-436a-aff0-5d43bf21f23d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.737660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08929f5a-d8d7-436a-aff0-5d43bf21f23d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.738344 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08929f5a-d8d7-436a-aff0-5d43bf21f23d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.738344 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08929f5a-d8d7-436a-aff0-5d43bf21f23d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:53.738344 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08929f5a-d8d7-436a-aff0-5d43bf21f23d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:53.738344 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-08929f5a-d8d7-436a-aff0-5d43bf21f23d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:53.980557 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-08929f5a-d8d7-436a-aff0-5d43bf21f23d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:53.999594 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-08929f5a-d8d7-436a-aff0-5d43bf21f23d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.321381 Aug 24 10:23:54.000581 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 427/851] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:53 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:54.751975 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:54.752730 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:54.761060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.764578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.764578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:54.764578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:54.764578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:54.765100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.023588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7b2d18db-6ce0-42e3-b96a-c818299c9630 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:55.024883 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7b2d18db-6ce0-42e3-b96a-c818299c9630 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:55.047941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7b2d18db-6ce0-42e3-b96a-c818299c9630 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.050304 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7b2d18db-6ce0-42e3-b96a-c818299c9630 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.050972 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7b2d18db-6ce0-42e3-b96a-c818299c9630 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.051956 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7b2d18db-6ce0-42e3-b96a-c818299c9630 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:55.057561 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7b2d18db-6ce0-42e3-b96a-c818299c9630 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:55.059711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7b2d18db-6ce0-42e3-b96a-c818299c9630 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:55.333872 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7b2d18db-6ce0-42e3-b96a-c818299c9630 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:55.345675 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7b2d18db-6ce0-42e3-b96a-c818299c9630 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.327085 Aug 24 10:23:55.346575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 428/852] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:55 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:55.429610 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:55.438373 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:55.439943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:55.442007 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5b15d9c6-aa98-4636-8402-149b6daec459 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.693548 Aug 24 10:23:55.442007 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 425/853] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:54 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:23:56.367857 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-01155e13-9750-4f15-95dd-fa3c6e04f6d5 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:56.368594 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-01155e13-9750-4f15-95dd-fa3c6e04f6d5 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:56.376443 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01155e13-9750-4f15-95dd-fa3c6e04f6d5 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:56.377161 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01155e13-9750-4f15-95dd-fa3c6e04f6d5 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:56.381464 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01155e13-9750-4f15-95dd-fa3c6e04f6d5 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:56.381464 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01155e13-9750-4f15-95dd-fa3c6e04f6d5 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:56.381464 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01155e13-9750-4f15-95dd-fa3c6e04f6d5 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:56.381464 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-01155e13-9750-4f15-95dd-fa3c6e04f6d5 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:56.466367 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:56.469269 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:56.474281 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:56.474848 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:56.475941 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:56.476654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:56.477216 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:56.477747 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:56.619925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-01155e13-9750-4f15-95dd-fa3c6e04f6d5 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:56.629113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-01155e13-9750-4f15-95dd-fa3c6e04f6d5 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.266298 Aug 24 10:23:56.629703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 429/854] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:56 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:56.637386 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:56.646317 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:56.649010 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:56.650620 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ec2f2b12-e495-4f7e-bd8c-e7eb81a93129 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.188429 Aug 24 10:23:56.651594 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 426/855] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:56 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:57.650912 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9dc65ea8-0e92-4283-b4a3-9e9a3fc4bef8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:57.651437 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9dc65ea8-0e92-4283-b4a3-9e9a3fc4bef8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:57.660021 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9dc65ea8-0e92-4283-b4a3-9e9a3fc4bef8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.660505 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9dc65ea8-0e92-4283-b4a3-9e9a3fc4bef8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.661173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9dc65ea8-0e92-4283-b4a3-9e9a3fc4bef8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.662028 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9dc65ea8-0e92-4283-b4a3-9e9a3fc4bef8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.663172 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9dc65ea8-0e92-4283-b4a3-9e9a3fc4bef8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.663746 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9dc65ea8-0e92-4283-b4a3-9e9a3fc4bef8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.678873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:57.679475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:57.681768 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:57.687002 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.687665 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.688261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.693399 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:57.693399 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:57.693399 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:57.823665 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9dc65ea8-0e92-4283-b4a3-9e9a3fc4bef8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:57.832457 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9dc65ea8-0e92-4283-b4a3-9e9a3fc4bef8 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.185873 Aug 24 10:23:57.845935 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 430/856] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:57 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:57.853723 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:57.862645 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:57.864208 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:57.865387 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-394bc520-991b-4b88-a4a9-4809db8e3880 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.191000 Aug 24 10:23:57.866459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 427/857] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:57 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:58.856638 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f15589d7-f9a2-4f44-a9f1-616f46f86245 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:58.857621 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f15589d7-f9a2-4f44-a9f1-616f46f86245 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:58.864371 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f15589d7-f9a2-4f44-a9f1-616f46f86245 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:58.864844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f15589d7-f9a2-4f44-a9f1-616f46f86245 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:58.868925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f15589d7-f9a2-4f44-a9f1-616f46f86245 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:58.868925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f15589d7-f9a2-4f44-a9f1-616f46f86245 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:58.868925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f15589d7-f9a2-4f44-a9f1-616f46f86245 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:58.868925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f15589d7-f9a2-4f44-a9f1-616f46f86245 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:58.890810 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:58.895961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:58.905413 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:58.909133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:58.909133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:58.909133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:58.909133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:58.909483 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.033453 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f15589d7-f9a2-4f44-a9f1-616f46f86245 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:59.042912 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f15589d7-f9a2-4f44-a9f1-616f46f86245 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1569 microversion: 2.1 time: 0.190162 Aug 24 10:23:59.043581 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 431/858] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:58 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:59.072098 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1f2b9322-94ba-49da-9ba4-360108fe07aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:59.072941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-1f2b9322-94ba-49da-9ba4-360108fe07aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:59.076683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:59.079045 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1f2b9322-94ba-49da-9ba4-360108fe07aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:59.098925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1f2b9322-94ba-49da-9ba4-360108fe07aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:59.098925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1f2b9322-94ba-49da-9ba4-360108fe07aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.098925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1f2b9322-94ba-49da-9ba4-360108fe07aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:59.098925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1f2b9322-94ba-49da-9ba4-360108fe07aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:59.099625 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1f2b9322-94ba-49da-9ba4-360108fe07aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.099904 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:59.099904 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:59.099904 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f5717152-6e9a-4226-b74a-d8674060f016 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.201921 Aug 24 10:23:59.100152 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 428/859] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:23:58 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 10:23:59.306557 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-1f2b9322-94ba-49da-9ba4-360108fe07aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121271) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 10:23:59.814881 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1f2b9322-94ba-49da-9ba4-360108fe07aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "POST /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182/action" status: 202 len: 0 microversion: 2.1 time: 0.746537 Aug 24 10:23:59.816234 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 432/860] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:23:59 2022] POST /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182/action => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:23:59.825540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-325c0b56-9f98-4081-9c9c-bf3653ed78af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:59.831844 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-325c0b56-9f98-4081-9c9c-bf3653ed78af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:59.833618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-325c0b56-9f98-4081-9c9c-bf3653ed78af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:59.834095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-325c0b56-9f98-4081-9c9c-bf3653ed78af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:59.834520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-325c0b56-9f98-4081-9c9c-bf3653ed78af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.835844 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-325c0b56-9f98-4081-9c9c-bf3653ed78af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:59.836462 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-325c0b56-9f98-4081-9c9c-bf3653ed78af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:59.836949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-325c0b56-9f98-4081-9c9c-bf3653ed78af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:59.976819 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-325c0b56-9f98-4081-9c9c-bf3653ed78af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:59.991826 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-325c0b56-9f98-4081-9c9c-bf3653ed78af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1517 microversion: 2.1 time: 0.170629 Aug 24 10:23:59.992722 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 429/861] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:59 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:00.113677 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:00.114544 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:00.127561 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:00.128269 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:00.128820 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:00.129808 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:00.130475 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:00.131156 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:00.325091 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:00.343601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:00.350813 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:00.354097 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7f11f70c-af34-4b35-8b19-5e7619a902bf tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.245434 Aug 24 10:24:00.357261 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 433/862] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:00 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:01.015552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-19a62f43-27ea-4781-b996-8dda31e2415b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:01.016886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-19a62f43-27ea-4781-b996-8dda31e2415b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:01.024340 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-19a62f43-27ea-4781-b996-8dda31e2415b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.024826 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-19a62f43-27ea-4781-b996-8dda31e2415b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.025282 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-19a62f43-27ea-4781-b996-8dda31e2415b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.026015 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-19a62f43-27ea-4781-b996-8dda31e2415b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.026467 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-19a62f43-27ea-4781-b996-8dda31e2415b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.026890 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-19a62f43-27ea-4781-b996-8dda31e2415b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.172487 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-19a62f43-27ea-4781-b996-8dda31e2415b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:01.182673 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-19a62f43-27ea-4781-b996-8dda31e2415b tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1517 microversion: 2.1 time: 0.171374 Aug 24 10:24:01.183561 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 430/863] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:01 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:01.379993 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:01.380703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:01.388088 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.388686 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.389189 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.389956 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:01.390528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:01.391013 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:01.532288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:01.543143 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:01.546705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:01.546705 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-36d875a5-edd4-4892-8226-5af9c551cc03 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.170218 Aug 24 10:24:01.546932 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 434/864] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:01 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:02.210819 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f843259e-0d56-4f31-a4dd-4a84019a1313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:02.212609 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f843259e-0d56-4f31-a4dd-4a84019a1313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:02.223873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f843259e-0d56-4f31-a4dd-4a84019a1313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.224721 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f843259e-0d56-4f31-a4dd-4a84019a1313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.225260 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f843259e-0d56-4f31-a4dd-4a84019a1313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.226153 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f843259e-0d56-4f31-a4dd-4a84019a1313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.226973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f843259e-0d56-4f31-a4dd-4a84019a1313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.227496 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f843259e-0d56-4f31-a4dd-4a84019a1313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.230765 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=100 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:02.347054 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-7b75a705-23e1-4942-954a-6a20cc947464 req-59c30bc3-089a-41b7-a5cd-faf1185fee90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246f3e69-c7bf-462e-88a0-e209d93b5603", "name": "network-vif-plugged", "status": "completed", "tag": "a92e393c-0dd2-4ec0-8147-c860a2c195f8"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:02.366533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-7b75a705-23e1-4942-954a-6a20cc947464 req-59c30bc3-089a-41b7-a5cd-faf1185fee90 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.366994 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-7b75a705-23e1-4942-954a-6a20cc947464 req-59c30bc3-089a-41b7-a5cd-faf1185fee90 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.371289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-7b75a705-23e1-4942-954a-6a20cc947464 req-59c30bc3-089a-41b7-a5cd-faf1185fee90 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.399758 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-7b75a705-23e1-4942-954a-6a20cc947464 req-59c30bc3-089a-41b7-a5cd-faf1185fee90 service nova] Creating event network-vif-plugged:a92e393c-0dd2-4ec0-8147-c860a2c195f8 for instance 246f3e69-c7bf-462e-88a0-e209d93b5603 on hv-cinder-85427 Aug 24 10:24:02.405157 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-7b75a705-23e1-4942-954a-6a20cc947464 req-59c30bc3-089a-41b7-a5cd-faf1185fee90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061635 Aug 24 10:24:02.406084 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 435/865] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:24:02.495218 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f843259e-0d56-4f31-a4dd-4a84019a1313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:02.503644 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f843259e-0d56-4f31-a4dd-4a84019a1313 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1519 microversion: 2.1 time: 0.301834 Aug 24 10:24:02.504489 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 431/866] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:02 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1519 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:02.574786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:02.575801 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:02.585511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.589841 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.590944 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.591930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:02.592622 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:02.593326 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:02.868468 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:02.877430 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:02.879182 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:02.881266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-23ab433c-9b97-4193-96ea-8442ec5a2e54 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.312542 Aug 24 10:24:02.881640 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 436/867] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:02 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:03.528637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6ebe9170-dd68-47b4-8527-e70d1332793c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:03.529709 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6ebe9170-dd68-47b4-8527-e70d1332793c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:03.537629 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebe9170-dd68-47b4-8527-e70d1332793c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:03.538794 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebe9170-dd68-47b4-8527-e70d1332793c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:03.539298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebe9170-dd68-47b4-8527-e70d1332793c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:03.540209 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebe9170-dd68-47b4-8527-e70d1332793c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:03.540727 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebe9170-dd68-47b4-8527-e70d1332793c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:03.541239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6ebe9170-dd68-47b4-8527-e70d1332793c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:03.682888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6ebe9170-dd68-47b4-8527-e70d1332793c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:03.690788 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6ebe9170-dd68-47b4-8527-e70d1332793c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1519 microversion: 2.1 time: 0.167109 Aug 24 10:24:03.692012 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 432/868] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:03 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:03.904139 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:03.904760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:03.911238 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:03.911721 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:03.912409 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:03.914068 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:03.914783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:03.915216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:04.049267 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:04.057905 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:04.059448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:04.060614 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0afe7d6a-27e0-447e-811a-e11907175d0d tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.160553 Aug 24 10:24:04.061341 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 437/869] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:03 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:04.423145 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-8748cb27-b544-4721-98ca-0e772b807b63 req-a8973646-8728-4707-a555-5d317ad80921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d352ff4a-5771-4d5d-a56c-9708b7e68182", "name": "network-vif-unplugged", "status": "completed", "tag": "ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:04.439684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-8748cb27-b544-4721-98ca-0e772b807b63 req-a8973646-8728-4707-a555-5d317ad80921 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:04.440472 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-8748cb27-b544-4721-98ca-0e772b807b63 req-a8973646-8728-4707-a555-5d317ad80921 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:04.441214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-8748cb27-b544-4721-98ca-0e772b807b63 req-a8973646-8728-4707-a555-5d317ad80921 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:04.466071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.compute.server_external_events [req-8748cb27-b544-4721-98ca-0e772b807b63 req-a8973646-8728-4707-a555-5d317ad80921 service nova] Unable to find a host for instance d352ff4a-5771-4d5d-a56c-9708b7e68182. Dropping event network-vif-unplugged {{(pid=121270) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 10:24:04.467860 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-8748cb27-b544-4721-98ca-0e772b807b63 req-a8973646-8728-4707-a555-5d317ad80921 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050616 Aug 24 10:24:04.468891 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 433/870] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 10:24:04.713833 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d751aae1-474e-4b55-beb9-282399bc5f03 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:04.714678 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d751aae1-474e-4b55-beb9-282399bc5f03 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:04.721170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751aae1-474e-4b55-beb9-282399bc5f03 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:04.721654 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751aae1-474e-4b55-beb9-282399bc5f03 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:04.722093 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751aae1-474e-4b55-beb9-282399bc5f03 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:04.722828 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751aae1-474e-4b55-beb9-282399bc5f03 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:04.723264 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751aae1-474e-4b55-beb9-282399bc5f03 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:04.723687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751aae1-474e-4b55-beb9-282399bc5f03 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:04.856408 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d751aae1-474e-4b55-beb9-282399bc5f03 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:04.867467 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d751aae1-474e-4b55-beb9-282399bc5f03 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1519 microversion: 2.1 time: 0.158470 Aug 24 10:24:04.868084 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 438/871] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:04 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:05.083654 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:05.084261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:05.090980 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.091462 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.091899 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.092590 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.093078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.093531 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.224391 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:05.233813 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:05.235578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:05.236742 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4dad29b4-8ac7-4e75-a758-da90bbccaf5a tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.157155 Aug 24 10:24:05.237340 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 434/872] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:05 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:05.888530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-80d59346-0680-4607-80eb-813b9d3febec tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:05.890300 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-80d59346-0680-4607-80eb-813b9d3febec tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:05.896707 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80d59346-0680-4607-80eb-813b9d3febec tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.897328 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80d59346-0680-4607-80eb-813b9d3febec tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.897937 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80d59346-0680-4607-80eb-813b9d3febec tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:05.898651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80d59346-0680-4607-80eb-813b9d3febec tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:05.899108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80d59346-0680-4607-80eb-813b9d3febec tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:05.899540 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80d59346-0680-4607-80eb-813b9d3febec tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:06.039870 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-80d59346-0680-4607-80eb-813b9d3febec tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:06.047794 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-80d59346-0680-4607-80eb-813b9d3febec tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1519 microversion: 2.1 time: 0.163115 Aug 24 10:24:06.048293 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 439/873] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:05 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:06.261232 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:06.262024 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:06.268836 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:06.269435 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:06.269870 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:06.270571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:06.271069 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:06.271492 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:06.402953 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:06.411262 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:06.412946 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:06.414302 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-98b9d3f4-bb2a-40ce-97cd-a1c2aeefc8f6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.158071 Aug 24 10:24:06.425102 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 435/874] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:06 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:07.070873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c7282bbc-763b-4863-ad08-cf6024824f9a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:07.071382 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c7282bbc-763b-4863-ad08-cf6024824f9a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:07.084339 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c7282bbc-763b-4863-ad08-cf6024824f9a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:07.085942 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c7282bbc-763b-4863-ad08-cf6024824f9a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:07.086502 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c7282bbc-763b-4863-ad08-cf6024824f9a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:07.087486 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c7282bbc-763b-4863-ad08-cf6024824f9a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:07.088348 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c7282bbc-763b-4863-ad08-cf6024824f9a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:07.088820 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c7282bbc-763b-4863-ad08-cf6024824f9a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:07.238071 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c7282bbc-763b-4863-ad08-cf6024824f9a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:07.250168 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c7282bbc-763b-4863-ad08-cf6024824f9a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1519 microversion: 2.1 time: 0.184850 Aug 24 10:24:07.250762 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 440/875] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:07 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:07.437753 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:07.438976 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:07.455611 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:07.456489 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:07.456957 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:07.457675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:07.458135 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:07.458567 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:07.626323 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:07.635230 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:07.636756 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:07.637984 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a07b50c1-bcfb-414f-bd5d-e7325d202024 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.204170 Aug 24 10:24:07.638559 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 436/876] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:07 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:08.272554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-5812280b-5550-4e07-85b6-bd4393692f7c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:08.273273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-5812280b-5550-4e07-85b6-bd4393692f7c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:08.280678 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5812280b-5550-4e07-85b6-bd4393692f7c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:08.281887 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5812280b-5550-4e07-85b6-bd4393692f7c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:08.282400 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5812280b-5550-4e07-85b6-bd4393692f7c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:08.283174 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5812280b-5550-4e07-85b6-bd4393692f7c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:08.283703 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5812280b-5550-4e07-85b6-bd4393692f7c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:08.284215 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5812280b-5550-4e07-85b6-bd4393692f7c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:08.437501 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-5812280b-5550-4e07-85b6-bd4393692f7c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:08.444692 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-5812280b-5550-4e07-85b6-bd4393692f7c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.176178 Aug 24 10:24:08.448894 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 441/877] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:08 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:08.661256 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:08.662014 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:08.670860 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:08.671614 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:08.672292 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:08.673382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:08.674052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:08.674688 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:08.812608 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:08.820883 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:08.822669 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:08.823905 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-283422d4-519a-44fd-9547-0add0d74c5ae tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.166494 Aug 24 10:24:08.824460 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 437/878] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:08 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:09.467236 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0a85c336-14fa-48c9-80d1-9a6aeb447fc4 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:09.467758 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0a85c336-14fa-48c9-80d1-9a6aeb447fc4 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:09.474169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a85c336-14fa-48c9-80d1-9a6aeb447fc4 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.474645 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a85c336-14fa-48c9-80d1-9a6aeb447fc4 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.475069 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a85c336-14fa-48c9-80d1-9a6aeb447fc4 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.475755 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a85c336-14fa-48c9-80d1-9a6aeb447fc4 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.476199 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a85c336-14fa-48c9-80d1-9a6aeb447fc4 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.476615 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0a85c336-14fa-48c9-80d1-9a6aeb447fc4 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.495938 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:09.618053 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0a85c336-14fa-48c9-80d1-9a6aeb447fc4 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:09.626253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0a85c336-14fa-48c9-80d1-9a6aeb447fc4 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.162762 Aug 24 10:24:09.626928 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 442/879] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:09 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:09.847348 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:09.847907 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:09.854601 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.855080 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.855516 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.856206 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:09.856657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:09.857121 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:09.994569 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:10.003513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:10.005040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:10.006216 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-184e35d0-fb74-40ce-8cf8-99204672a714 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.163208 Aug 24 10:24:10.006777 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 438/880] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:09 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:10.650558 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-5f7ff815-8375-4156-9234-3fde9464770c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:10.651173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-5f7ff815-8375-4156-9234-3fde9464770c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:10.657523 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5f7ff815-8375-4156-9234-3fde9464770c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:10.658007 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5f7ff815-8375-4156-9234-3fde9464770c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:10.658474 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5f7ff815-8375-4156-9234-3fde9464770c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:10.659166 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5f7ff815-8375-4156-9234-3fde9464770c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:10.659623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5f7ff815-8375-4156-9234-3fde9464770c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:10.660045 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5f7ff815-8375-4156-9234-3fde9464770c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:10.792262 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-5f7ff815-8375-4156-9234-3fde9464770c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:10.800034 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-5f7ff815-8375-4156-9234-3fde9464770c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.155139 Aug 24 10:24:10.800600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 443/881] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:10 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:11.031913 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:11.033087 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:11.039979 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:11.040650 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:11.041349 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:11.042112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:11.042574 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:11.042998 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:11.283178 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:11.297466 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:11.299207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:11.300536 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2ee9123f-3b4f-4ea9-acd1-204668802190 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1731 microversion: 2.20 time: 0.273967 Aug 24 10:24:11.301431 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 439/882] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:11 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:11.822219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e577ed6a-7c24-452b-9dff-b425d16d9605 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:11.822872 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e577ed6a-7c24-452b-9dff-b425d16d9605 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:11.829604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e577ed6a-7c24-452b-9dff-b425d16d9605 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:11.830085 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e577ed6a-7c24-452b-9dff-b425d16d9605 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:11.830517 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e577ed6a-7c24-452b-9dff-b425d16d9605 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:11.831209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e577ed6a-7c24-452b-9dff-b425d16d9605 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:11.831659 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e577ed6a-7c24-452b-9dff-b425d16d9605 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:11.832202 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e577ed6a-7c24-452b-9dff-b425d16d9605 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:11.971782 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e577ed6a-7c24-452b-9dff-b425d16d9605 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:11.979689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e577ed6a-7c24-452b-9dff-b425d16d9605 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.162232 Aug 24 10:24:11.980185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 444/883] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:11 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:12.324631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:12.325414 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:12.332478 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:12.333027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:12.333517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:12.334224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:12.334706 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:12.335156 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:12.467103 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:12.475267 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:12.477184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:12.478635 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7ad0cb4d-232a-4403-88ac-5998a5d22ee7 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1718 microversion: 2.20 time: 0.158882 Aug 24 10:24:12.479200 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 440/884] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:12 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:13.001714 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0af06055-48ab-4fa9-9d11-4ab23aba04aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:13.002391 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0af06055-48ab-4fa9-9d11-4ab23aba04aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:13.009220 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0af06055-48ab-4fa9-9d11-4ab23aba04aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:13.009830 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0af06055-48ab-4fa9-9d11-4ab23aba04aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:13.010426 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0af06055-48ab-4fa9-9d11-4ab23aba04aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:13.011167 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0af06055-48ab-4fa9-9d11-4ab23aba04aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:13.011627 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0af06055-48ab-4fa9-9d11-4ab23aba04aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:13.012057 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0af06055-48ab-4fa9-9d11-4ab23aba04aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:13.164209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0af06055-48ab-4fa9-9d11-4ab23aba04aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:13.176732 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0af06055-48ab-4fa9-9d11-4ab23aba04aa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.178739 Aug 24 10:24:13.177727 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 445/885] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:12 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:14.199119 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-df946de0-c6df-41e8-ade1-a35daef23253 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:14.199722 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-df946de0-c6df-41e8-ade1-a35daef23253 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:14.206201 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df946de0-c6df-41e8-ade1-a35daef23253 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:14.206676 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df946de0-c6df-41e8-ade1-a35daef23253 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:14.207101 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df946de0-c6df-41e8-ade1-a35daef23253 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:14.207930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df946de0-c6df-41e8-ade1-a35daef23253 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:14.208238 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df946de0-c6df-41e8-ade1-a35daef23253 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:14.208652 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df946de0-c6df-41e8-ade1-a35daef23253 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:14.347300 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-df946de0-c6df-41e8-ade1-a35daef23253 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:14.358691 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-df946de0-c6df-41e8-ade1-a35daef23253 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.163584 Aug 24 10:24:14.359293 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 441/886] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:14 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:15.380736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9d03a547-71c8-4377-bcb1-6c307424bcfa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:15.381421 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9d03a547-71c8-4377-bcb1-6c307424bcfa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:15.389106 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d03a547-71c8-4377-bcb1-6c307424bcfa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:15.391711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d03a547-71c8-4377-bcb1-6c307424bcfa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:15.391711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d03a547-71c8-4377-bcb1-6c307424bcfa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:15.391711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d03a547-71c8-4377-bcb1-6c307424bcfa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:15.391711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d03a547-71c8-4377-bcb1-6c307424bcfa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:15.392591 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9d03a547-71c8-4377-bcb1-6c307424bcfa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:15.531137 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-9d03a547-71c8-4377-bcb1-6c307424bcfa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:15.539343 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9d03a547-71c8-4377-bcb1-6c307424bcfa tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.162456 Aug 24 10:24:15.539977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 446/887] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:15 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:16.562257 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ef9c808f-701c-46d6-949e-0a7e4631ad2d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:16.562866 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ef9c808f-701c-46d6-949e-0a7e4631ad2d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:16.569605 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ef9c808f-701c-46d6-949e-0a7e4631ad2d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.570088 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ef9c808f-701c-46d6-949e-0a7e4631ad2d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.570525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ef9c808f-701c-46d6-949e-0a7e4631ad2d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.571212 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ef9c808f-701c-46d6-949e-0a7e4631ad2d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:16.572157 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ef9c808f-701c-46d6-949e-0a7e4631ad2d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:16.572572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ef9c808f-701c-46d6-949e-0a7e4631ad2d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:16.740140 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ef9c808f-701c-46d6-949e-0a7e4631ad2d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:16.750107 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ef9c808f-701c-46d6-949e-0a7e4631ad2d tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.192373 Aug 24 10:24:16.750715 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 442/888] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:16 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:17.772526 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-16cd9a6c-f356-4da4-a809-7edc5ab2c6f7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:17.773285 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-16cd9a6c-f356-4da4-a809-7edc5ab2c6f7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:17.780543 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16cd9a6c-f356-4da4-a809-7edc5ab2c6f7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.781089 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16cd9a6c-f356-4da4-a809-7edc5ab2c6f7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.781530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16cd9a6c-f356-4da4-a809-7edc5ab2c6f7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.782235 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16cd9a6c-f356-4da4-a809-7edc5ab2c6f7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:17.783060 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16cd9a6c-f356-4da4-a809-7edc5ab2c6f7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:17.783293 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-16cd9a6c-f356-4da4-a809-7edc5ab2c6f7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:17.939526 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-16cd9a6c-f356-4da4-a809-7edc5ab2c6f7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:17.948635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-16cd9a6c-f356-4da4-a809-7edc5ab2c6f7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.180200 Aug 24 10:24:17.949272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 447/889] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:17 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:18.971584 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d07ddf1f-6b44-477a-875b-bfaeae4d7213 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:18.972201 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d07ddf1f-6b44-477a-875b-bfaeae4d7213 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:18.979314 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d07ddf1f-6b44-477a-875b-bfaeae4d7213 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:18.993011 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d07ddf1f-6b44-477a-875b-bfaeae4d7213 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:18.993011 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d07ddf1f-6b44-477a-875b-bfaeae4d7213 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:18.993011 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d07ddf1f-6b44-477a-875b-bfaeae4d7213 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:18.993011 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d07ddf1f-6b44-477a-875b-bfaeae4d7213 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:18.994368 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d07ddf1f-6b44-477a-875b-bfaeae4d7213 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:19.188147 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d07ddf1f-6b44-477a-875b-bfaeae4d7213 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:19.198105 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d07ddf1f-6b44-477a-875b-bfaeae4d7213 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.230500 Aug 24 10:24:19.199423 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 443/890] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:18 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:20.220669 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c1a6d3c9-6fe3-43ee-89ea-ef5018b391cc tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:20.222288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c1a6d3c9-6fe3-43ee-89ea-ef5018b391cc tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:20.224799 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:20.229737 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c1a6d3c9-6fe3-43ee-89ea-ef5018b391cc tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:20.230291 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c1a6d3c9-6fe3-43ee-89ea-ef5018b391cc tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:20.230729 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c1a6d3c9-6fe3-43ee-89ea-ef5018b391cc tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:20.231436 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c1a6d3c9-6fe3-43ee-89ea-ef5018b391cc tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:20.232364 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c1a6d3c9-6fe3-43ee-89ea-ef5018b391cc tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:20.233228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c1a6d3c9-6fe3-43ee-89ea-ef5018b391cc tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:20.406692 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c1a6d3c9-6fe3-43ee-89ea-ef5018b391cc tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:20.417635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c1a6d3c9-6fe3-43ee-89ea-ef5018b391cc tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.200759 Aug 24 10:24:20.418469 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 448/891] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:20 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:20.684018 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-0f0ad42b-8213-4af7-9d77-a78474133da7 req-fbda91ad-b645-4692-a9a7-50984cd45efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d352ff4a-5771-4d5d-a56c-9708b7e68182", "name": "network-vif-plugged", "status": "completed", "tag": "ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:20.699289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-0f0ad42b-8213-4af7-9d77-a78474133da7 req-fbda91ad-b645-4692-a9a7-50984cd45efb service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:20.699897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-0f0ad42b-8213-4af7-9d77-a78474133da7 req-fbda91ad-b645-4692-a9a7-50984cd45efb service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:20.700487 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-0f0ad42b-8213-4af7-9d77-a78474133da7 req-fbda91ad-b645-4692-a9a7-50984cd45efb service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:20.718804 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-0f0ad42b-8213-4af7-9d77-a78474133da7 req-fbda91ad-b645-4692-a9a7-50984cd45efb service nova] Creating event network-vif-plugged:ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77 for instance d352ff4a-5771-4d5d-a56c-9708b7e68182 on hv-cinder-85427 Aug 24 10:24:20.729189 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-0f0ad42b-8213-4af7-9d77-a78474133da7 req-fbda91ad-b645-4692-a9a7-50984cd45efb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049556 Aug 24 10:24:20.729808 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 444/892] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:21.441596 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2b9b089e-bd61-4dbc-a7f4-11902f5021af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:21.442209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2b9b089e-bd61-4dbc-a7f4-11902f5021af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:21.448928 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b9b089e-bd61-4dbc-a7f4-11902f5021af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:21.449417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b9b089e-bd61-4dbc-a7f4-11902f5021af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:21.449851 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b9b089e-bd61-4dbc-a7f4-11902f5021af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:21.450546 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b9b089e-bd61-4dbc-a7f4-11902f5021af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:21.450999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b9b089e-bd61-4dbc-a7f4-11902f5021af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:21.451420 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2b9b089e-bd61-4dbc-a7f4-11902f5021af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:21.594960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2b9b089e-bd61-4dbc-a7f4-11902f5021af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:21.603259 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2b9b089e-bd61-4dbc-a7f4-11902f5021af tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.165859 Aug 24 10:24:21.604049 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 449/893] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:21 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:22.625885 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2d92dc1f-ab1d-4576-b0f1-12518f1efba1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:22.626605 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2d92dc1f-ab1d-4576-b0f1-12518f1efba1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:22.632528 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d92dc1f-ab1d-4576-b0f1-12518f1efba1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:22.633042 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d92dc1f-ab1d-4576-b0f1-12518f1efba1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:22.633470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d92dc1f-ab1d-4576-b0f1-12518f1efba1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:22.634157 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d92dc1f-ab1d-4576-b0f1-12518f1efba1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:22.634776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d92dc1f-ab1d-4576-b0f1-12518f1efba1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:22.635192 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2d92dc1f-ab1d-4576-b0f1-12518f1efba1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:22.768026 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2d92dc1f-ab1d-4576-b0f1-12518f1efba1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:22.776655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2d92dc1f-ab1d-4576-b0f1-12518f1efba1 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.155442 Aug 24 10:24:22.777242 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 445/894] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:22 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:23.799023 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2c967912-d109-4aed-bb09-f892167f4b8a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:23.799673 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2c967912-d109-4aed-bb09-f892167f4b8a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:23.806098 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c967912-d109-4aed-bb09-f892167f4b8a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:23.807375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c967912-d109-4aed-bb09-f892167f4b8a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:23.807847 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c967912-d109-4aed-bb09-f892167f4b8a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:23.808546 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c967912-d109-4aed-bb09-f892167f4b8a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:23.809039 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c967912-d109-4aed-bb09-f892167f4b8a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:23.809473 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2c967912-d109-4aed-bb09-f892167f4b8a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:23.959603 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2c967912-d109-4aed-bb09-f892167f4b8a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:23.968251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2c967912-d109-4aed-bb09-f892167f4b8a tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.173880 Aug 24 10:24:23.969060 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 450/895] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:23 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:24.990052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c7d20d96-7a7f-4e8c-aaba-6b777e647179 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:24.990750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c7d20d96-7a7f-4e8c-aaba-6b777e647179 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:24.997278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d20d96-7a7f-4e8c-aaba-6b777e647179 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:24.997835 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d20d96-7a7f-4e8c-aaba-6b777e647179 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:24.998359 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d20d96-7a7f-4e8c-aaba-6b777e647179 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:24.999177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d20d96-7a7f-4e8c-aaba-6b777e647179 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:24.999697 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d20d96-7a7f-4e8c-aaba-6b777e647179 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:25.000184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c7d20d96-7a7f-4e8c-aaba-6b777e647179 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:25.134714 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c7d20d96-7a7f-4e8c-aaba-6b777e647179 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:25.143308 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c7d20d96-7a7f-4e8c-aaba-6b777e647179 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1575 microversion: 2.1 time: 0.157924 Aug 24 10:24:25.143875 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 446/896] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:24 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:24:26.165757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8febe298-0593-4c6a-b05c-f79c9ccaf1a7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:26.166440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8febe298-0593-4c6a-b05c-f79c9ccaf1a7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:26.174396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8febe298-0593-4c6a-b05c-f79c9ccaf1a7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:26.175020 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8febe298-0593-4c6a-b05c-f79c9ccaf1a7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:26.175661 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8febe298-0593-4c6a-b05c-f79c9ccaf1a7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:26.176146 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8febe298-0593-4c6a-b05c-f79c9ccaf1a7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:26.176597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8febe298-0593-4c6a-b05c-f79c9ccaf1a7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:26.177050 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8febe298-0593-4c6a-b05c-f79c9ccaf1a7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:26.331153 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8febe298-0593-4c6a-b05c-f79c9ccaf1a7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:26.340948 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8febe298-0593-4c6a-b05c-f79c9ccaf1a7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1562 microversion: 2.1 time: 0.179084 Aug 24 10:24:26.357206 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 451/897] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:24:26 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:48.916651 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=39 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:48.917485 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=87 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:48.922341 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0a030fe1-0907-4ce0-b51c-d98777bc0be5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:48.929732 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0a030fe1-0907-4ce0-b51c-d98777bc0be5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:48.932934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a030fe1-0907-4ce0-b51c-d98777bc0be5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:48.933461 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a030fe1-0907-4ce0-b51c-d98777bc0be5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:48.933956 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a030fe1-0907-4ce0-b51c-d98777bc0be5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:48.934682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a030fe1-0907-4ce0-b51c-d98777bc0be5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:48.935138 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a030fe1-0907-4ce0-b51c-d98777bc0be5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:48.935618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a030fe1-0907-4ce0-b51c-d98777bc0be5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:48.975558 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0a030fe1-0907-4ce0-b51c-d98777bc0be5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060354 Aug 24 10:24:48.982140 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 447/898] 10.222.0.30 () {60 vars in 1343 bytes} [Wed Aug 24 10:24:48 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:24:49.055412 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f3b6e37b-c192-44eb-871a-f42973b2c6d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:49.060687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f3b6e37b-c192-44eb-871a-f42973b2c6d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:49.060687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=7 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:49.060687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=57 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:24:49.063922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f3b6e37b-c192-44eb-871a-f42973b2c6d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:49.064411 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f3b6e37b-c192-44eb-871a-f42973b2c6d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:49.064852 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f3b6e37b-c192-44eb-871a-f42973b2c6d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.065606 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f3b6e37b-c192-44eb-871a-f42973b2c6d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:49.066061 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f3b6e37b-c192-44eb-871a-f42973b2c6d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:49.066486 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f3b6e37b-c192-44eb-871a-f42973b2c6d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.092178 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f3b6e37b-c192-44eb-871a-f42973b2c6d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:24:49.519859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f3b6e37b-c192-44eb-871a-f42973b2c6d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 204 len: 0 microversion: 2.20 time: 0.468172 Aug 24 10:24:49.520451 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 452/899] 10.222.0.30 () {60 vars in 1280 bytes} [Wed Aug 24 10:24:49 2022] DELETE /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:24:49.533960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:49.534579 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:49.541625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:49.542368 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:49.542804 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.543617 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:49.543952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:49.544376 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:49.728207 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:49.737483 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:49.741378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:49.741378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-60af9b4d-82bd-4cc3-ab38-172ea412bc29 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.211739 Aug 24 10:24:49.741378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 448/900] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:49 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:50.772991 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:50.772991 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:50.773789 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:50.774086 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:50.774518 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:50.775224 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:50.775666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:50.776253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:50.930000 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:50.939741 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:50.949986 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:50.949986 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8515411b-ce03-4a23-aef4-508735be078c tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.181548 Aug 24 10:24:50.949986 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 453/901] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:50 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:51.970213 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:51.972037 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:51.982155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.985542 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.986459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:51.987670 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:51.988521 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:51.989368 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:52.167488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:52.177855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:52.179382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:52.180674 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b133b2d7-1801-48d1-bffa-24e8a61edda5 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1724 microversion: 2.20 time: 0.218156 Aug 24 10:24:52.181154 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 449/902] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:51 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:52.549878 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-d28748c1-40bf-4085-991b-780a3c87e708 req-33875110-f900-48ba-8553-a4afb003d9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246f3e69-c7bf-462e-88a0-e209d93b5603", "name": "network-vif-deleted", "tag": "a92e393c-0dd2-4ec0-8147-c860a2c195f8"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:24:52.574190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d28748c1-40bf-4085-991b-780a3c87e708 req-33875110-f900-48ba-8553-a4afb003d9a3 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:52.575149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d28748c1-40bf-4085-991b-780a3c87e708 req-33875110-f900-48ba-8553-a4afb003d9a3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:52.575741 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d28748c1-40bf-4085-991b-780a3c87e708 req-33875110-f900-48ba-8553-a4afb003d9a3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:52.605213 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-d28748c1-40bf-4085-991b-780a3c87e708 req-33875110-f900-48ba-8553-a4afb003d9a3 service nova] Creating event network-vif-deleted:a92e393c-0dd2-4ec0-8147-c860a2c195f8 for instance 246f3e69-c7bf-462e-88a0-e209d93b5603 on hv-cinder-85427 Aug 24 10:24:52.620680 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-d28748c1-40bf-4085-991b-780a3c87e708 req-33875110-f900-48ba-8553-a4afb003d9a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075505 Aug 24 10:24:52.626560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 454/903] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:24:53.206561 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:53.207163 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:53.215408 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.216214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.216698 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.217632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.218086 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.218733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.254392 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:53.254847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:53.255280 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:53.255921 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lazy-loading 'fault' on Instance uuid 246f3e69-c7bf-462e-88a0-e209d93b5603 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:24:53.309043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:53.330494 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:53.332584 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d72e2cc5b804b0bb556599a26d923ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad90b6c7dd947dda6faa1fc1feb6d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:24:53.334674 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1ccaa39f-f074-49b5-ad07-e9c1b3132c69 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 200 len: 1371 microversion: 2.20 time: 0.132729 Aug 24 10:24:53.349310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 450/904] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:53 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 10:24:54.360943 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:54.361668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:54.370068 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:54.370773 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:54.371211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:54.371918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:54.373199 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:54.373199 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:54.388302 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] HTTP exception thrown: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Request method failure captured: Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 HTTP/1.1 Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfr2dTVrYbhvg-XS6yk4rxeOQxdi7BW0_2_ujp5KXpdzvI3JxACKwzgfOXMejML0tmzbkZE2RXmfffyo4jhZx7YzRzR0WyvjOtN593QcnwQD5Zhc3ZWpiuOVuNklXZNwJh_1empr8q28jkHCkM4dFXpmS6PtbTzThLtcj62HL_AYNro Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:24:54.389992 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad90b6c7dd947dda6faa1fc1feb6d7b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 8d72e2cc5b804b0bb556599a26d923ac Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:54.391884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '246f3e69-c7bf-462e-88a0-e209d93b5603'} Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:54.392817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:54.395280 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:54.397354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Returning 404 to user: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:54.397354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-36cfde8e-9e67-4582-8b0d-80c519d572d9 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 404 len: 111 microversion: 2.20 time: 0.035807 Aug 24 10:24:54.397354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 455/905] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:54 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:54.401956 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-fb45457a-88f3-43e9-97fd-3605f0e9ddf6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '.version_select at 0x7f0af4110f70>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:54.509933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-fb45457a-88f3-43e9-97fd-3605f0e9ddf6 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2034883282" status: 204 len: 0 microversion: 2.20 time: 0.111631 Aug 24 10:24:54.513173 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 451/906] 10.222.0.30 () {60 vars in 1262 bytes} [Wed Aug 24 10:24:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2034883282 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 10:24:56.821885 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:56.823100 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:56.830782 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:56.831349 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:56.831869 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:56.832634 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:56.833179 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:56.833683 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:56.847969 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] HTTP exception thrown: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Request method failure captured: Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: DELETE /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 HTTP/1.1 Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfr2dTVrYbhvg-XS6yk4rxeOQxdi7BW0_2_ujp5KXpdzvI3JxACKwzgfOXMejML0tmzbkZE2RXmfffyo4jhZx7YzRzR0WyvjOtN593QcnwQD5Zhc3ZWpiuOVuNklXZNwJh_1empr8q28jkHCkM4dFXpmS6PtbTzThLtcj62HL_AYNro Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:24:56.854514 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad90b6c7dd947dda6faa1fc1feb6d7b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 8d72e2cc5b804b0bb556599a26d923ac Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:56.856413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '246f3e69-c7bf-462e-88a0-e209d93b5603'} Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:56.857366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:56.859790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:56.861389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Returning 404 to user: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:56.861389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d37aefc0-8eb6-441f-b3eb-118250eb76db tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 404 len: 111 microversion: 2.20 time: 0.033319 Aug 24 10:24:56.861389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 456/907] 10.222.0.30 () {60 vars in 1280 bytes} [Wed Aug 24 10:24:56 2022] DELETE /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:56.862501 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:56.863125 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: 246f3e69-c7bf-462e-88a0-e209d93b5603] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:56.870310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:56.870799 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:56.871240 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:56.871956 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:56.872401 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:56.872819 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:56.887469 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] HTTP exception thrown: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Request method failure captured: Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 HTTP/1.1 Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfr2dTVrYbhvg-XS6yk4rxeOQxdi7BW0_2_ujp5KXpdzvI3JxACKwzgfOXMejML0tmzbkZE2RXmfffyo4jhZx7YzRzR0WyvjOtN593QcnwQD5Zhc3ZWpiuOVuNklXZNwJh_1empr8q28jkHCkM4dFXpmS6PtbTzThLtcj62HL_AYNro Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:24:56.889251 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad90b6c7dd947dda6faa1fc1feb6d7b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 8d72e2cc5b804b0bb556599a26d923ac Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:56.891177 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '246f3e69-c7bf-462e-88a0-e209d93b5603'} Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:56.892095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. Aug 24 10:24:56.894745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:24:56.895933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Returning 404 to user: Instance 246f3e69-c7bf-462e-88a0-e209d93b5603 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:56.895933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bcd23b7f-f557-4516-8b6c-29e684d87071 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603" status: 404 len: 111 microversion: 2.20 time: 0.033480 Aug 24 10:24:56.895933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 452/908] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:56 2022] GET /compute/v2.1/servers/246f3e69-c7bf-462e-88a0-e209d93b5603 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:58.363904 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:58.364528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:58.373317 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.374557 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.375043 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.375860 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.376326 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.376757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.395830 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] HTTP exception thrown: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Request method failure captured: Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: DELETE /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 HTTP/1.1 Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfr2dTVrYbhvg-XS6yk4rxeOQxdi7BW0_2_ujp5KXpdzvI3JxACKwzgfOXMejML0tmzbkZE2RXmfffyo4jhZx7YzRzR0WyvjOtN593QcnwQD5Zhc3ZWpiuOVuNklXZNwJh_1empr8q28jkHCkM4dFXpmS6PtbTzThLtcj62HL_AYNro Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:24:58.397560 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad90b6c7dd947dda6faa1fc1feb6d7b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 8d72e2cc5b804b0bb556599a26d923ac Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:24:58.399648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': 'ac36f3b6-c66c-406b-b472-0a2dd018d4c3'} Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:58.400423 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:24:58.402149 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:24:58.403744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Returning 404 to user: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:58.403744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2f7be843-79ce-4882-9b5f-0f6e6d71be63 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 404 len: 111 microversion: 2.20 time: 0.039976 Aug 24 10:24:58.403744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 457/909] 10.222.0.30 () {60 vars in 1280 bytes} [Wed Aug 24 10:24:58 2022] DELETE /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:24:58.408556 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:24:58.409211 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] [instance: ac36f3b6-c66c-406b-b472-0a2dd018d4c3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:24:58.415915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.416407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.416843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.417596 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:24:58.418054 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:24:58.418509 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:24:58.434524 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] HTTP exception thrown: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Request method failure captured: Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 HTTP/1.1 Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfr2dTVrYbhvg-XS6yk4rxeOQxdi7BW0_2_ujp5KXpdzvI3JxACKwzgfOXMejML0tmzbkZE2RXmfffyo4jhZx7YzRzR0WyvjOtN593QcnwQD5Zhc3ZWpiuOVuNklXZNwJh_1empr8q28jkHCkM4dFXpmS6PtbTzThLtcj62HL_AYNro Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:24:58.436735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad90b6c7dd947dda6faa1fc1feb6d7b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad90b6c7dd947dda6faa1fc1feb6d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: dad90b6c7dd947dda6faa1fc1feb6d7b Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1580189118 Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 8d72e2cc5b804b0bb556599a26d923ac Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1580189118-project Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:24:58.439443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': 'ac36f3b6-c66c-406b-b472-0a2dd018d4c3'} Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:24:58.440874 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. Aug 24 10:24:58.443833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:24:58.446486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] Returning 404 to user: Instance ac36f3b6-c66c-406b-b472-0a2dd018d4c3 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:24:58.446486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ad4d50e6-f851-4562-8a0d-b016b7f40670 tempest-AttachVolumeShelveTestJSON-1580189118 tempest-AttachVolumeShelveTestJSON-1580189118-project] 10.222.0.30 "GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3" status: 404 len: 111 microversion: 2.20 time: 0.034513 Aug 24 10:24:58.446486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 453/910] 10.222.0.30 () {60 vars in 1277 bytes} [Wed Aug 24 10:24:58 2022] GET /compute/v2.1/servers/ac36f3b6-c66c-406b-b472-0a2dd018d4c3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:25:07.257713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-621e37ca-a99b-4467-818c-f0bd27237e8e tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0af40623a0>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:07.309113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-621e37ca-a99b-4467-818c-f0bd27237e8e tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0b759849-b4d7-47bb-9dd1-818a6c61ee13" status: 200 len: 351 microversion: 2.1 time: 0.053820 Aug 24 10:25:07.310440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 458/911] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:25:07 2022] GET /compute/v2.1/os-volumes/0b759849-b4d7-47bb-9dd1-818a6c61ee13 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:10.187471 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8e327f58-24cd-4f5d-b633-ff10cb667cf6 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0af4182c10>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:10.195050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:10.195763 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=30 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:10.238499 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8e327f58-24cd-4f5d-b633-ff10cb667cf6 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/29aba465-a906-40c5-a68a-d3f008853ef0" status: 200 len: 351 microversion: 2.1 time: 0.054734 Aug 24 10:25:10.239073 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 454/912] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:25:10 2022] GET /compute/v2.1/os-volumes/29aba465-a906-40c5-a68a-d3f008853ef0 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:12.321891 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:12.323387 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:25:12.327181 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-73d62115-4698-4605-a3dd-0c2907fc553b tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0ae7f534c0>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:12.380451 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-73d62115-4698-4605-a3dd-0c2907fc553b tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/571966bc-ab1f-4adb-984b-fecef7468e00" status: 200 len: 351 microversion: 2.1 time: 0.059893 Aug 24 10:25:12.381201 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 459/913] 10.222.0.30 () {58 vars in 1245 bytes} [Wed Aug 24 10:25:12 2022] GET /compute/v2.1/os-volumes/571966bc-ab1f-4adb-984b-fecef7468e00 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:12.395184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4132b554-8e57-4a62-a924-d0ae841d7798 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0af40abc10>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:12.482681 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4132b554-8e57-4a62-a924-d0ae841d7798 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.092835 Aug 24 10:25:12.483568 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 455/914] 10.222.0.30 () {58 vars in 1134 bytes} [Wed Aug 24 10:25:12 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:12.497578 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1b58dd8b-18a9-43b8-8941-3fe0fec80b22 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0ae7f53160>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:12.750031 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1b58dd8b-18a9-43b8-8941-3fe0fec80b22 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.256102 Aug 24 10:25:12.750726 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 460/915] 10.222.0.30 () {58 vars in 1149 bytes} [Wed Aug 24 10:25:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:12.764749 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0f87500d-0e30-4203-a751-9485dc83a806 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0af40ab9d0>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:12.850472 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0f87500d-0e30-4203-a751-9485dc83a806 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089612 Aug 24 10:25:12.851054 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 456/916] 10.222.0.30 () {58 vars in 1134 bytes} [Wed Aug 24 10:25:12 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:12.863991 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-96a17770-e4ee-42b0-a495-b2509022f078 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0ae7f40670>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:12.953321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-96a17770-e4ee-42b0-a495-b2509022f078 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093118 Aug 24 10:25:12.953943 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 461/917] 10.222.0.30 () {58 vars in 1167 bytes} [Wed Aug 24 10:25:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:12.970575 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8dbfd90e-a198-4158-87b8-c00066f01cb2 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0af4071c10>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:13.059703 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8dbfd90e-a198-4158-87b8-c00066f01cb2 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091851 Aug 24 10:25:13.059703 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 457/918] 10.222.0.30 () {58 vars in 1170 bytes} [Wed Aug 24 10:25:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:13.069998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-15e1e8b0-4fc5-4747-b1e5-90fbd1e12d45 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0ae7fed670>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:13.154262 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-15e1e8b0-4fc5-4747-b1e5-90fbd1e12d45 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087938 Aug 24 10:25:13.155076 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 462/919] 10.222.0.30 () {58 vars in 1155 bytes} [Wed Aug 24 10:25:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:13.168234 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-213ac365-0711-4bd0-a044-72a81793cf33 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0af412a9d0>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:13.255950 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-213ac365-0711-4bd0-a044-72a81793cf33 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091395 Aug 24 10:25:13.256519 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 458/920] 10.222.0.30 () {58 vars in 1188 bytes} [Wed Aug 24 10:25:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:25:13.269407 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-80fac71d-8c05-4075-8a0e-1630a5bba503 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] Calling method '.version_select at 0x7f0ae7fed430>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:13.355518 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-80fac71d-8c05-4075-8a0e-1630a5bba503 tempest-VolumesTestJSON-1834986413 tempest-VolumesTestJSON-1834986413-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089720 Aug 24 10:25:13.356427 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 463/921] 10.222.0.30 () {58 vars in 1155 bytes} [Wed Aug 24 10:25:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:50.629913 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-150fe6ca-4660-47ff-8178-66211a836376 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:50.630559 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-150fe6ca-4660-47ff-8178-66211a836376 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:50.635657 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-b324cc75-40bb-4ff6-8bdc-b58c0275520d req-3ba745ae-05b2-4866-bca2-212268a680c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d352ff4a-5771-4d5d-a56c-9708b7e68182", "tag": "ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:50.641001 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150fe6ca-4660-47ff-8178-66211a836376 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:50.641638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150fe6ca-4660-47ff-8178-66211a836376 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:50.642295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150fe6ca-4660-47ff-8178-66211a836376 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:50.644576 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150fe6ca-4660-47ff-8178-66211a836376 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:50.645137 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150fe6ca-4660-47ff-8178-66211a836376 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:50.647032 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-b324cc75-40bb-4ff6-8bdc-b58c0275520d req-3ba745ae-05b2-4866-bca2-212268a680c7 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:50.647524 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-b324cc75-40bb-4ff6-8bdc-b58c0275520d req-3ba745ae-05b2-4866-bca2-212268a680c7 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:50.647642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-150fe6ca-4660-47ff-8178-66211a836376 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:50.647969 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-b324cc75-40bb-4ff6-8bdc-b58c0275520d req-3ba745ae-05b2-4866-bca2-212268a680c7 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:50.659193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-b324cc75-40bb-4ff6-8bdc-b58c0275520d req-3ba745ae-05b2-4866-bca2-212268a680c7 service nova] Creating event network-changed:ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77 for instance d352ff4a-5771-4d5d-a56c-9708b7e68182 on hv-cinder-85427 Aug 24 10:25:50.669873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-b324cc75-40bb-4ff6-8bdc-b58c0275520d req-3ba745ae-05b2-4866-bca2-212268a680c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039244 Aug 24 10:25:50.670475 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 464/922] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:25:50.681925 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-150fe6ca-4660-47ff-8178-66211a836376 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Going to try to terminate instance {{(pid=121270) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:25:51.040552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-150fe6ca-4660-47ff-8178-66211a836376 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 204 len: 0 microversion: 2.1 time: 0.415003 Aug 24 10:25:51.044835 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 459/923] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:25:50 2022] DELETE /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:25:51.051555 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b4420dd3-598c-4869-bd2e-86145d6e3b4f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:51.052393 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b4420dd3-598c-4869-bd2e-86145d6e3b4f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:51.080220 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4420dd3-598c-4869-bd2e-86145d6e3b4f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:51.080727 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4420dd3-598c-4869-bd2e-86145d6e3b4f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:51.081268 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4420dd3-598c-4869-bd2e-86145d6e3b4f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:51.081996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4420dd3-598c-4869-bd2e-86145d6e3b4f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:51.091016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4420dd3-598c-4869-bd2e-86145d6e3b4f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:51.091694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b4420dd3-598c-4869-bd2e-86145d6e3b4f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:51.421324 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b4420dd3-598c-4869-bd2e-86145d6e3b4f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:51.432921 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b4420dd3-598c-4869-bd2e-86145d6e3b4f tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.385667 Aug 24 10:25:51.449572 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 465/924] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:51 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:25:51.641697 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1789550184", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "networks": [{"uuid": "ed163e95-0377-4eec-9e74-d5cd8366787d"}]}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:51.712253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] validate_networks() for [('ed163e95-0377-4eec-9e74-d5cd8366787d', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:25:52.125674 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:25:52.128820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:25:52.128820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:25:52.128820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:25:52.128820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:25:52.138662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:52.139274 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:52.139664 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:52.140272 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:52.140929 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:52.141364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:52.158657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Getting quotas for project 7d5efdccb2b64693a0a950c711114f3a. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:25:52.169016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Getting quotas for user 82c3bba1fcac455684cc0c8190f8231e and project 7d5efdccb2b64693a0a950c711114f3a. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:25:52.183089 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:25:52.185730 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:25:52.325780 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cdd42677-8537-43b0-bf53-5fc33530f70c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689912 Aug 24 10:25:52.326685 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 460/925] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:25:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:25:52.337308 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-6f94def4-454c-443a-aa2a-3049c193cd7f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:52.338205 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-6f94def4-454c-443a-aa2a-3049c193cd7f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:52.405028 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-6f94def4-454c-443a-aa2a-3049c193cd7f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:52.414694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-6f94def4-454c-443a-aa2a-3049c193cd7f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1219 microversion: 2.1 time: 0.081179 Aug 24 10:25:52.428998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 466/926] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:52 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:52.455171 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e182dba6-ba22-4813-8292-ada61a881750 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:52.458992 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-e182dba6-ba22-4813-8292-ada61a881750 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:52.466413 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e182dba6-ba22-4813-8292-ada61a881750 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:52.468145 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e182dba6-ba22-4813-8292-ada61a881750 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:52.468604 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e182dba6-ba22-4813-8292-ada61a881750 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:52.470284 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e182dba6-ba22-4813-8292-ada61a881750 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:52.473063 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e182dba6-ba22-4813-8292-ada61a881750 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:52.473516 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e182dba6-ba22-4813-8292-ada61a881750 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:53.103613 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e182dba6-ba22-4813-8292-ada61a881750 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:53.114540 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e182dba6-ba22-4813-8292-ada61a881750 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1568 microversion: 2.1 time: 0.663204 Aug 24 10:25:53.118684 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 461/927] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:52 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1568 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:53.435642 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-778e1449-e53a-476c-9d2b-be628d5311e0 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:53.436269 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-778e1449-e53a-476c-9d2b-be628d5311e0 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:53.633554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-778e1449-e53a-476c-9d2b-be628d5311e0 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:53.641442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-778e1449-e53a-476c-9d2b-be628d5311e0 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1219 microversion: 2.1 time: 0.209572 Aug 24 10:25:53.665112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 467/928] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:53 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1219 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:54.148632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-30d72c8a-e8b5-4dd8-a448-9f8955d71dc7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:54.148632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-30d72c8a-e8b5-4dd8-a448-9f8955d71dc7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:54.156929 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-508c35ef-c13f-4519-93f0-b1b4e63783e0 req-bdbda205-83bc-41d4-bf2d-2a4c66ff3292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d352ff4a-5771-4d5d-a56c-9708b7e68182", "name": "network-vif-deleted", "tag": "ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:25:54.166625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30d72c8a-e8b5-4dd8-a448-9f8955d71dc7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.167311 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30d72c8a-e8b5-4dd8-a448-9f8955d71dc7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.170234 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-508c35ef-c13f-4519-93f0-b1b4e63783e0 req-bdbda205-83bc-41d4-bf2d-2a4c66ff3292 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.170590 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30d72c8a-e8b5-4dd8-a448-9f8955d71dc7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.171082 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-508c35ef-c13f-4519-93f0-b1b4e63783e0 req-bdbda205-83bc-41d4-bf2d-2a4c66ff3292 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.171717 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-508c35ef-c13f-4519-93f0-b1b4e63783e0 req-bdbda205-83bc-41d4-bf2d-2a4c66ff3292 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.173539 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30d72c8a-e8b5-4dd8-a448-9f8955d71dc7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.176758 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30d72c8a-e8b5-4dd8-a448-9f8955d71dc7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.179081 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-30d72c8a-e8b5-4dd8-a448-9f8955d71dc7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.187693 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-508c35ef-c13f-4519-93f0-b1b4e63783e0 req-bdbda205-83bc-41d4-bf2d-2a4c66ff3292 service nova] Creating event network-vif-deleted:ecfa2bf8-dcf6-49a2-a0dc-4870e1c7de77 for instance d352ff4a-5771-4d5d-a56c-9708b7e68182 on hv-cinder-85427 Aug 24 10:25:54.193979 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-508c35ef-c13f-4519-93f0-b1b4e63783e0 req-bdbda205-83bc-41d4-bf2d-2a4c66ff3292 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042323 Aug 24 10:25:54.199287 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 468/929] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:25:54.283770 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-30d72c8a-e8b5-4dd8-a448-9f8955d71dc7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:54.297325 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-30d72c8a-e8b5-4dd8-a448-9f8955d71dc7 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1382 microversion: 2.1 time: 0.157433 Aug 24 10:25:54.309941 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 462/930] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:54 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1382 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:54.665173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-be0cbb53-20ba-4bfa-8b5f-bbd56ace6d9f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:54.666500 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-be0cbb53-20ba-4bfa-8b5f-bbd56ace6d9f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:54.680160 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-be0cbb53-20ba-4bfa-8b5f-bbd56ace6d9f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.680656 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-be0cbb53-20ba-4bfa-8b5f-bbd56ace6d9f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.683159 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-be0cbb53-20ba-4bfa-8b5f-bbd56ace6d9f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.684720 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-be0cbb53-20ba-4bfa-8b5f-bbd56ace6d9f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:54.686071 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-be0cbb53-20ba-4bfa-8b5f-bbd56ace6d9f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:54.691101 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-be0cbb53-20ba-4bfa-8b5f-bbd56ace6d9f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:54.825940 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-be0cbb53-20ba-4bfa-8b5f-bbd56ace6d9f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:54.843568 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-be0cbb53-20ba-4bfa-8b5f-bbd56ace6d9f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1215 microversion: 2.1 time: 0.182744 Aug 24 10:25:54.844615 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 469/931] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:54 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1215 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:55.324121 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:55.328974 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:55.359310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:55.361103 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:55.365086 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:55.366406 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:55.367588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:55.370821 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:55.460819 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:55.461688 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:55.462605 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:55.465276 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lazy-loading 'fault' on Instance uuid d352ff4a-5771-4d5d-a56c-9708b7e68182 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:25:55.874561 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0bdecda0-5dc9-4b23-869a-a252fcfb3007 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:55.875295 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0bdecda0-5dc9-4b23-869a-a252fcfb3007 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:55.885270 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0bdecda0-5dc9-4b23-869a-a252fcfb3007 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:55.889586 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0bdecda0-5dc9-4b23-869a-a252fcfb3007 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:55.890041 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0bdecda0-5dc9-4b23-869a-a252fcfb3007 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:55.890952 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0bdecda0-5dc9-4b23-869a-a252fcfb3007 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:55.892697 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0bdecda0-5dc9-4b23-869a-a252fcfb3007 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:55.893327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0bdecda0-5dc9-4b23-869a-a252fcfb3007 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:55.944761 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28281bb90464004a751699a49c61ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c601f7e6b64f83919d960b601e9331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:55.958711 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-88ce942f-dd97-46ee-8fb0-40d1d254f40c tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 200 len: 1225 microversion: 2.1 time: 0.639966 Aug 24 10:25:55.959955 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 463/932] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:55 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 1225 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:56.028156 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0bdecda0-5dc9-4b23-869a-a252fcfb3007 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:56.048950 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0bdecda0-5dc9-4b23-869a-a252fcfb3007 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1271 microversion: 2.1 time: 0.184608 Aug 24 10:25:56.051595 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 470/933] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:55 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:57.003765 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:57.005220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] [instance: d352ff4a-5771-4d5d-a56c-9708b7e68182] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:57.027176 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:57.028096 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:57.028547 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:57.032600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:57.032600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:57.032600 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:57.066732 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] HTTP exception thrown: Instance d352ff4a-5771-4d5d-a56c-9708b7e68182 could not be found. Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Request method failure captured: Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 HTTP/1.1 Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBft-51Z_5ObGK1K-pSDf8MbmALnBrmkq1tfBZcOTLe-grK9_K_DCMtvBEIKcvjZ0p-RLtD1OaqG8sL0Mp4sl-0GU-g8WvysuWkA58v6odE5TW44Z1mGeP6vc8bu2qOopOQ7w-53ku8JGnmYb5-Mr2K1ISICS2qAuv3GC1X7M5-P0IQk Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: f2c601f7e6b64f83919d960b601e9331 Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-TestShelveInstance-62538790 Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:25:57.077513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2c601f7e6b64f83919d960b601e9331", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2c601f7e6b64f83919d960b601e9331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2c601f7e6b64f83919d960b601e9331"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2c601f7e6b64f83919d960b601e9331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-TestShelveInstance-62538790 Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: f2c601f7e6b64f83919d960b601e9331 Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-TestShelveInstance-62538790 Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-TestShelveInstance-62538790-project Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: c28281bb90464004a751699a49c61ebf Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-TestShelveInstance-62538790-project Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance d352ff4a-5771-4d5d-a56c-9708b7e68182 could not be found. Aug 24 10:25:57.079058 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': 'd352ff4a-5771-4d5d-a56c-9708b7e68182'} Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d352ff4a-5771-4d5d-a56c-9708b7e68182 could not be found. Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:25:57.079873 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d352ff4a-5771-4d5d-a56c-9708b7e68182 could not be found. Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d352ff4a-5771-4d5d-a56c-9708b7e68182 could not be found. Aug 24 10:25:57.081459 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:25:57.085792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Returning 404 to user: Instance d352ff4a-5771-4d5d-a56c-9708b7e68182 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:25:57.087214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-aab7a34e-6fe9-4289-a1f0-6cc319bf3b26 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182" status: 404 len: 111 microversion: 2.1 time: 0.106317 Aug 24 10:25:57.087214 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 464/934] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:56 2022] GET /compute/v2.1/servers/d352ff4a-5771-4d5d-a56c-9708b7e68182 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:25:57.095918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-795860ba-26c5-4069-a767-905522801a64 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:57.101203 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-795860ba-26c5-4069-a767-905522801a64 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:57.117614 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-795860ba-26c5-4069-a767-905522801a64 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:57.118116 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-795860ba-26c5-4069-a767-905522801a64 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:57.118558 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-795860ba-26c5-4069-a767-905522801a64 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:57.126192 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-795860ba-26c5-4069-a767-905522801a64 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:57.126783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-795860ba-26c5-4069-a767-905522801a64 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:57.266580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-795860ba-26c5-4069-a767-905522801a64 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:57.266580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-795860ba-26c5-4069-a767-905522801a64 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:57.266580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-795860ba-26c5-4069-a767-905522801a64 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1289 microversion: 2.1 time: 0.145775 Aug 24 10:25:57.266580 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 471/935] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:57 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1289 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:57.561884 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-84b48183-b13d-4ceb-b148-97a0e51cc083 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] Calling method '.version_select at 0x7f0af4110af0>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:57.673680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-84b48183-b13d-4ceb-b148-97a0e51cc083 tempest-TestShelveInstance-62538790 tempest-TestShelveInstance-62538790-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1965718378" status: 202 len: 0 microversion: 2.1 time: 0.115537 Aug 24 10:25:57.674347 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 465/936] 10.222.0.30 () {58 vars in 1254 bytes} [Wed Aug 24 10:25:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1965718378 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:25:58.290207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b60c8f11-e706-419c-a63d-0ae8c58467b2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:58.292164 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b60c8f11-e706-419c-a63d-0ae8c58467b2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:58.303324 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b60c8f11-e706-419c-a63d-0ae8c58467b2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:58.304927 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b60c8f11-e706-419c-a63d-0ae8c58467b2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:58.328399 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b60c8f11-e706-419c-a63d-0ae8c58467b2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:58.328399 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b60c8f11-e706-419c-a63d-0ae8c58467b2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:58.328399 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b60c8f11-e706-419c-a63d-0ae8c58467b2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:58.328399 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b60c8f11-e706-419c-a63d-0ae8c58467b2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:58.768284 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b60c8f11-e706-419c-a63d-0ae8c58467b2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:25:58.781201 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b60c8f11-e706-419c-a63d-0ae8c58467b2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1277 microversion: 2.1 time: 0.491597 Aug 24 10:25:58.781747 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 472/937] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:58 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1277 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:25:59.816403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ebe267eb-81e2-4cb8-a0b3-f58099e8727d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:25:59.817825 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ebe267eb-81e2-4cb8-a0b3-f58099e8727d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:25:59.834649 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ebe267eb-81e2-4cb8-a0b3-f58099e8727d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:59.835473 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ebe267eb-81e2-4cb8-a0b3-f58099e8727d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:59.837343 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ebe267eb-81e2-4cb8-a0b3-f58099e8727d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:25:59.840678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ebe267eb-81e2-4cb8-a0b3-f58099e8727d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:25:59.841348 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ebe267eb-81e2-4cb8-a0b3-f58099e8727d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:25:59.841672 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ebe267eb-81e2-4cb8-a0b3-f58099e8727d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:00.161864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ebe267eb-81e2-4cb8-a0b3-f58099e8727d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:00.170879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ebe267eb-81e2-4cb8-a0b3-f58099e8727d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1319 microversion: 2.1 time: 0.358778 Aug 24 10:26:00.172108 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 466/938] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:25:59 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:01.199742 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-26271256-633b-4682-b27f-34819ac52703 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:01.201030 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-26271256-633b-4682-b27f-34819ac52703 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:01.208073 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26271256-633b-4682-b27f-34819ac52703 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:01.208564 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26271256-633b-4682-b27f-34819ac52703 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:01.209074 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26271256-633b-4682-b27f-34819ac52703 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:01.209900 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26271256-633b-4682-b27f-34819ac52703 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:01.210345 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26271256-633b-4682-b27f-34819ac52703 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:01.210770 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-26271256-633b-4682-b27f-34819ac52703 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:01.364435 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-26271256-633b-4682-b27f-34819ac52703 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:01.372170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-26271256-633b-4682-b27f-34819ac52703 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1319 microversion: 2.1 time: 0.176900 Aug 24 10:26:01.372736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 473/939] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:01 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:01.429669 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-393b7b65-48ea-4879-9420-8e22bbf1d540 req-0762b1b3-4dae-49b2-ab7b-c9e16cf63ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eaba60b-1efd-43fb-8304-7d9c3889b97a", "tag": "6b07ab11-673d-4cde-aad0-1c26b2ba02fb"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:01.444167 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-393b7b65-48ea-4879-9420-8e22bbf1d540 req-0762b1b3-4dae-49b2-ab7b-c9e16cf63ab3 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:01.445949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-393b7b65-48ea-4879-9420-8e22bbf1d540 req-0762b1b3-4dae-49b2-ab7b-c9e16cf63ab3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:01.446291 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-393b7b65-48ea-4879-9420-8e22bbf1d540 req-0762b1b3-4dae-49b2-ab7b-c9e16cf63ab3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:01.461648 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-393b7b65-48ea-4879-9420-8e22bbf1d540 req-0762b1b3-4dae-49b2-ab7b-c9e16cf63ab3 service nova] Creating event network-changed:6b07ab11-673d-4cde-aad0-1c26b2ba02fb for instance 7eaba60b-1efd-43fb-8304-7d9c3889b97a on hv-cinder-85427 Aug 24 10:26:01.467258 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-393b7b65-48ea-4879-9420-8e22bbf1d540 req-0762b1b3-4dae-49b2-ab7b-c9e16cf63ab3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049795 Aug 24 10:26:01.468506 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 467/940] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:02.397487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d12b8897-3a44-487a-9338-d9781b8c6408 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:02.399229 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d12b8897-3a44-487a-9338-d9781b8c6408 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:02.408003 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d12b8897-3a44-487a-9338-d9781b8c6408 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:02.408777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d12b8897-3a44-487a-9338-d9781b8c6408 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:02.410062 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d12b8897-3a44-487a-9338-d9781b8c6408 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:02.410964 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d12b8897-3a44-487a-9338-d9781b8c6408 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:02.411911 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d12b8897-3a44-487a-9338-d9781b8c6408 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:02.412687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d12b8897-3a44-487a-9338-d9781b8c6408 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:02.639864 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d12b8897-3a44-487a-9338-d9781b8c6408 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:02.650179 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d12b8897-3a44-487a-9338-d9781b8c6408 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1319 microversion: 2.1 time: 0.259358 Aug 24 10:26:02.652740 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 474/941] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:02 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:03.672146 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-dad360c6-3e59-495b-939b-30f723eabba8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:03.673796 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-dad360c6-3e59-495b-939b-30f723eabba8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:03.684651 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:03.685610 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=6 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:03.689222 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dad360c6-3e59-495b-939b-30f723eabba8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.691736 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dad360c6-3e59-495b-939b-30f723eabba8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.691736 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dad360c6-3e59-495b-939b-30f723eabba8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:03.691736 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dad360c6-3e59-495b-939b-30f723eabba8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:03.698827 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dad360c6-3e59-495b-939b-30f723eabba8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:03.699516 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dad360c6-3e59-495b-939b-30f723eabba8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:04.030646 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-dad360c6-3e59-495b-939b-30f723eabba8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:04.042155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-dad360c6-3e59-495b-939b-30f723eabba8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1319 microversion: 2.1 time: 0.374291 Aug 24 10:26:04.048917 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 468/942] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:03 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:05.063044 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e7dc865c-51b5-4af3-bfba-130a21fa3213 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:05.063679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e7dc865c-51b5-4af3-bfba-130a21fa3213 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:05.071432 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=4 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:05.079062 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7dc865c-51b5-4af3-bfba-130a21fa3213 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:05.080012 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7dc865c-51b5-4af3-bfba-130a21fa3213 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:05.080743 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7dc865c-51b5-4af3-bfba-130a21fa3213 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:05.096282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7dc865c-51b5-4af3-bfba-130a21fa3213 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:05.096282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7dc865c-51b5-4af3-bfba-130a21fa3213 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:05.096282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e7dc865c-51b5-4af3-bfba-130a21fa3213 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:05.380277 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e7dc865c-51b5-4af3-bfba-130a21fa3213 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:05.391397 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e7dc865c-51b5-4af3-bfba-130a21fa3213 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1319 microversion: 2.1 time: 0.330835 Aug 24 10:26:05.391397 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 475/943] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:05 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:06.415607 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0467e764-0d7a-4b7d-9a9d-d3ee01422511 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:06.416295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0467e764-0d7a-4b7d-9a9d-d3ee01422511 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:06.423989 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0467e764-0d7a-4b7d-9a9d-d3ee01422511 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:06.425531 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0467e764-0d7a-4b7d-9a9d-d3ee01422511 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:06.426227 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0467e764-0d7a-4b7d-9a9d-d3ee01422511 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:06.427171 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0467e764-0d7a-4b7d-9a9d-d3ee01422511 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:06.427644 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0467e764-0d7a-4b7d-9a9d-d3ee01422511 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:06.428114 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0467e764-0d7a-4b7d-9a9d-d3ee01422511 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:06.590785 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0467e764-0d7a-4b7d-9a9d-d3ee01422511 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:06.600789 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0467e764-0d7a-4b7d-9a9d-d3ee01422511 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1319 microversion: 2.1 time: 0.189950 Aug 24 10:26:06.601733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 469/944] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:06 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:06.865978 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-481e0f7d-b0f2-4d07-af21-9d79df6796a8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Action: 'create', calling method: .version_select at 0x7f0af4036ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-539561095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8HueRXlYa7NoRrrPRYPpM3XwefS6JqB2OHzESEbja5Eg+ZLub/fbES4NyYQ/ph/B5d4gYgInUVpFPJbB54xHtzu9EixaNI+aK4e533VWXpu3oZdAJ8pFOMEit/UFlWHw=="}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:06.888401 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-481e0f7d-b0f2-4d07-af21-9d79df6796a8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Getting quotas for project e9980d2c52934ca38dfb4d3dfbf9700b. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:06.895546 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-481e0f7d-b0f2-4d07-af21-9d79df6796a8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Getting quotas for user 8744189102a44d47a3b994bfe49fd8e1 and project e9980d2c52934ca38dfb4d3dfbf9700b. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:07.090681 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-481e0f7d-b0f2-4d07-af21-9d79df6796a8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.228723 Aug 24 10:26:07.092441 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 476/945] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Aug 24 10:26:06 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:07.306252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1841060302", "imageRef": "93d5a260-768b-489d-8284-3d7b271c3843", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-539561095", "networks": [{"uuid": "743cd524-30bf-4b9e-a31c-2cadd84e766f"}]}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:07.374106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] validate_networks() for [('743cd524-30bf-4b9e-a31c-2cadd84e766f', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:26:07.623256 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e3da7ef1-f4e2-46d3-be66-3e37de832e09 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:07.624022 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e3da7ef1-f4e2-46d3-be66-3e37de832e09 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:07.632758 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e3da7ef1-f4e2-46d3-be66-3e37de832e09 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:07.633425 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e3da7ef1-f4e2-46d3-be66-3e37de832e09 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:07.634372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e3da7ef1-f4e2-46d3-be66-3e37de832e09 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:07.635460 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e3da7ef1-f4e2-46d3-be66-3e37de832e09 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:07.636099 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e3da7ef1-f4e2-46d3-be66-3e37de832e09 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:07.636688 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e3da7ef1-f4e2-46d3-be66-3e37de832e09 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:07.871709 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:26:07.872737 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:26:07.873538 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:26:07.874901 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:26:07.875694 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:26:07.896999 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:07.898040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:07.898040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:07.898618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:07.899048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:07.899472 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:07.928317 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e3da7ef1-f4e2-46d3-be66-3e37de832e09 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:07.929541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Getting quotas for project e9980d2c52934ca38dfb4d3dfbf9700b. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:07.938151 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Getting quotas for user 8744189102a44d47a3b994bfe49fd8e1 and project e9980d2c52934ca38dfb4d3dfbf9700b. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:07.939589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e3da7ef1-f4e2-46d3-be66-3e37de832e09 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1319 microversion: 2.1 time: 0.321005 Aug 24 10:26:07.941642 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 477/946] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:07 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:07.980123 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:26:07.989220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93d5a260-768b-489d-8284-3d7b271c3843',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:26:08.142166 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2473eb76-e607-44b2-bc23-f24b94026a1b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845895 Aug 24 10:26:08.144328 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 470/947] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:26:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:26:08.163975 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-20569d17-759b-427a-94ba-3037e9308bbc tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:08.165107 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-20569d17-759b-427a-94ba-3037e9308bbc tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:08.235244 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-20569d17-759b-427a-94ba-3037e9308bbc tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:08.243544 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-20569d17-759b-427a-94ba-3037e9308bbc tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1258 microversion: 2.1 time: 0.089691 Aug 24 10:26:08.244561 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 478/948] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:08 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1258 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:08.970406 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8648d3cd-8848-4a5d-95bc-2c3d8c8e2ae7 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:08.976576 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8648d3cd-8848-4a5d-95bc-2c3d8c8e2ae7 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:08.984904 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8648d3cd-8848-4a5d-95bc-2c3d8c8e2ae7 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:08.986231 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8648d3cd-8848-4a5d-95bc-2c3d8c8e2ae7 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:08.987382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8648d3cd-8848-4a5d-95bc-2c3d8c8e2ae7 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:08.989045 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8648d3cd-8848-4a5d-95bc-2c3d8c8e2ae7 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:08.989846 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8648d3cd-8848-4a5d-95bc-2c3d8c8e2ae7 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:08.990426 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8648d3cd-8848-4a5d-95bc-2c3d8c8e2ae7 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:09.204344 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8648d3cd-8848-4a5d-95bc-2c3d8c8e2ae7 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:09.215624 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8648d3cd-8848-4a5d-95bc-2c3d8c8e2ae7 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1319 microversion: 2.1 time: 0.252693 Aug 24 10:26:09.229578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 471/949] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:08 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:09.266455 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b6fb2367-eba7-4db3-b574-220c1ab497c7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:09.266949 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b6fb2367-eba7-4db3-b574-220c1ab497c7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:09.331628 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b6fb2367-eba7-4db3-b574-220c1ab497c7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:09.341734 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b6fb2367-eba7-4db3-b574-220c1ab497c7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1258 microversion: 2.1 time: 0.079287 Aug 24 10:26:09.344576 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 479/950] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:09 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:09.404127 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-4994225a-b42c-4f8b-a43f-0bd91c7c3071 req-0723cc76-9335-4a8f-be47-4b29bc828702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eaba60b-1efd-43fb-8304-7d9c3889b97a", "name": "network-vif-plugged", "status": "completed", "tag": "6b07ab11-673d-4cde-aad0-1c26b2ba02fb"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:09.414922 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-4994225a-b42c-4f8b-a43f-0bd91c7c3071 req-0723cc76-9335-4a8f-be47-4b29bc828702 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:09.415587 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-4994225a-b42c-4f8b-a43f-0bd91c7c3071 req-0723cc76-9335-4a8f-be47-4b29bc828702 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:09.416171 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-4994225a-b42c-4f8b-a43f-0bd91c7c3071 req-0723cc76-9335-4a8f-be47-4b29bc828702 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:09.433396 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-4994225a-b42c-4f8b-a43f-0bd91c7c3071 req-0723cc76-9335-4a8f-be47-4b29bc828702 service nova] Creating event network-vif-plugged:6b07ab11-673d-4cde-aad0-1c26b2ba02fb for instance 7eaba60b-1efd-43fb-8304-7d9c3889b97a on hv-cinder-85427 Aug 24 10:26:09.441103 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-4994225a-b42c-4f8b-a43f-0bd91c7c3071 req-0723cc76-9335-4a8f-be47-4b29bc828702 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041691 Aug 24 10:26:09.442403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 472/951] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:10.237118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-61985e1f-0ca6-443e-a49c-9b705be9dbc2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:10.237742 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-61985e1f-0ca6-443e-a49c-9b705be9dbc2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:10.243937 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61985e1f-0ca6-443e-a49c-9b705be9dbc2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:10.244420 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61985e1f-0ca6-443e-a49c-9b705be9dbc2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:10.245001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61985e1f-0ca6-443e-a49c-9b705be9dbc2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:10.246884 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61985e1f-0ca6-443e-a49c-9b705be9dbc2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:10.247371 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61985e1f-0ca6-443e-a49c-9b705be9dbc2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:10.247814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-61985e1f-0ca6-443e-a49c-9b705be9dbc2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:10.374369 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-82e32434-9be8-491d-883e-efd176eb04f6 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:10.376446 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-82e32434-9be8-491d-883e-efd176eb04f6 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:10.387729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82e32434-9be8-491d-883e-efd176eb04f6 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:10.388689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82e32434-9be8-491d-883e-efd176eb04f6 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:10.389718 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82e32434-9be8-491d-883e-efd176eb04f6 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:10.390923 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82e32434-9be8-491d-883e-efd176eb04f6 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:10.391624 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82e32434-9be8-491d-883e-efd176eb04f6 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:10.392409 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-82e32434-9be8-491d-883e-efd176eb04f6 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:10.418590 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-61985e1f-0ca6-443e-a49c-9b705be9dbc2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:10.427182 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-61985e1f-0ca6-443e-a49c-9b705be9dbc2 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1319 microversion: 2.1 time: 0.194036 Aug 24 10:26:10.427769 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 480/952] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:10 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:10.465830 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-82e32434-9be8-491d-883e-efd176eb04f6 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:10.473602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-82e32434-9be8-491d-883e-efd176eb04f6 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1254 microversion: 2.1 time: 0.105910 Aug 24 10:26:10.474184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 473/953] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:10 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1254 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:11.448329 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4f93bfde-b97c-4a60-bfeb-31695987c90e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:11.449036 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4f93bfde-b97c-4a60-bfeb-31695987c90e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:11.455630 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4f93bfde-b97c-4a60-bfeb-31695987c90e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:11.456228 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4f93bfde-b97c-4a60-bfeb-31695987c90e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:11.456674 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4f93bfde-b97c-4a60-bfeb-31695987c90e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:11.457415 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4f93bfde-b97c-4a60-bfeb-31695987c90e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:11.457869 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4f93bfde-b97c-4a60-bfeb-31695987c90e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:11.458497 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4f93bfde-b97c-4a60-bfeb-31695987c90e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:11.504631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e4ae91f8-68e7-407d-986b-cb1accb4a4ef tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:11.505270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-e4ae91f8-68e7-407d-986b-cb1accb4a4ef tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:11.528216 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e4ae91f8-68e7-407d-986b-cb1accb4a4ef tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:11.529475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e4ae91f8-68e7-407d-986b-cb1accb4a4ef tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:11.529918 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e4ae91f8-68e7-407d-986b-cb1accb4a4ef tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:11.530809 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e4ae91f8-68e7-407d-986b-cb1accb4a4ef tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:11.531461 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e4ae91f8-68e7-407d-986b-cb1accb4a4ef tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:11.532067 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e4ae91f8-68e7-407d-986b-cb1accb4a4ef tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:11.623747 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4f93bfde-b97c-4a60-bfeb-31695987c90e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:11.626184 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e4ae91f8-68e7-407d-986b-cb1accb4a4ef tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:11.639989 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4f93bfde-b97c-4a60-bfeb-31695987c90e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1507 microversion: 2.1 time: 0.188034 Aug 24 10:26:11.639989 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 481/954] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:11 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:11.650527 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e4ae91f8-68e7-407d-986b-cb1accb4a4ef tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1318 microversion: 2.1 time: 0.157738 Aug 24 10:26:11.651155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 474/955] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:11 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:12.680153 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1e8c857c-4a75-4c12-b6da-8242d2b4e57a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:12.681859 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-1e8c857c-4a75-4c12-b6da-8242d2b4e57a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:12.689583 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1e8c857c-4a75-4c12-b6da-8242d2b4e57a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:12.691101 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1e8c857c-4a75-4c12-b6da-8242d2b4e57a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:12.691921 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1e8c857c-4a75-4c12-b6da-8242d2b4e57a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:12.692930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1e8c857c-4a75-4c12-b6da-8242d2b4e57a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:12.694319 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1e8c857c-4a75-4c12-b6da-8242d2b4e57a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:12.694873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1e8c857c-4a75-4c12-b6da-8242d2b4e57a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:12.771059 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1e8c857c-4a75-4c12-b6da-8242d2b4e57a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:12.778809 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1e8c857c-4a75-4c12-b6da-8242d2b4e57a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1316 microversion: 2.1 time: 0.102499 Aug 24 10:26:12.797554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 482/956] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:12 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1316 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:13.818491 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5ce68928-38a3-4e43-b7c2-cdf68683625b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:13.819043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5ce68928-38a3-4e43-b7c2-cdf68683625b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:13.825711 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ce68928-38a3-4e43-b7c2-cdf68683625b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.826216 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ce68928-38a3-4e43-b7c2-cdf68683625b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.826642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ce68928-38a3-4e43-b7c2-cdf68683625b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.827368 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ce68928-38a3-4e43-b7c2-cdf68683625b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:13.828013 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ce68928-38a3-4e43-b7c2-cdf68683625b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:13.828671 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ce68928-38a3-4e43-b7c2-cdf68683625b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:13.994317 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5ce68928-38a3-4e43-b7c2-cdf68683625b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:14.003962 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5ce68928-38a3-4e43-b7c2-cdf68683625b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.189619 Aug 24 10:26:14.003962 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 475/957] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:13 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:15.026230 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ab321bed-8577-46b3-bcb8-fbcd2a5d5e3e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:15.027048 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ab321bed-8577-46b3-bcb8-fbcd2a5d5e3e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:15.036755 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ab321bed-8577-46b3-bcb8-fbcd2a5d5e3e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:15.040369 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ab321bed-8577-46b3-bcb8-fbcd2a5d5e3e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:15.040369 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ab321bed-8577-46b3-bcb8-fbcd2a5d5e3e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:15.040369 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ab321bed-8577-46b3-bcb8-fbcd2a5d5e3e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:15.040369 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ab321bed-8577-46b3-bcb8-fbcd2a5d5e3e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:15.041766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ab321bed-8577-46b3-bcb8-fbcd2a5d5e3e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:15.239609 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-ab321bed-8577-46b3-bcb8-fbcd2a5d5e3e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:15.248807 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ab321bed-8577-46b3-bcb8-fbcd2a5d5e3e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.228267 Aug 24 10:26:15.257600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 483/958] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:15 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:16.271608 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5ccfec4c-5eba-4132-9346-1138779a312e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:16.272222 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5ccfec4c-5eba-4132-9346-1138779a312e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:16.279096 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ccfec4c-5eba-4132-9346-1138779a312e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:16.279761 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ccfec4c-5eba-4132-9346-1138779a312e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:16.280389 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ccfec4c-5eba-4132-9346-1138779a312e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:16.281313 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ccfec4c-5eba-4132-9346-1138779a312e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:16.281929 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ccfec4c-5eba-4132-9346-1138779a312e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:16.282519 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5ccfec4c-5eba-4132-9346-1138779a312e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:16.433930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-5ccfec4c-5eba-4132-9346-1138779a312e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:16.448421 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5ccfec4c-5eba-4132-9346-1138779a312e tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.181144 Aug 24 10:26:16.449772 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 476/959] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:16 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:17.472569 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-748647a3-742c-489c-ab8b-58b1170ed3f2 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:17.473334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-748647a3-742c-489c-ab8b-58b1170ed3f2 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:17.480199 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-748647a3-742c-489c-ab8b-58b1170ed3f2 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:17.480689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-748647a3-742c-489c-ab8b-58b1170ed3f2 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:17.481162 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-748647a3-742c-489c-ab8b-58b1170ed3f2 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:17.482123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-748647a3-742c-489c-ab8b-58b1170ed3f2 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:17.482588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-748647a3-742c-489c-ab8b-58b1170ed3f2 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:17.483017 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-748647a3-742c-489c-ab8b-58b1170ed3f2 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:17.629896 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-748647a3-742c-489c-ab8b-58b1170ed3f2 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:17.648329 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-748647a3-742c-489c-ab8b-58b1170ed3f2 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.180426 Aug 24 10:26:17.649920 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 484/960] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:17 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:18.675052 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-ea61afdc-c658-4832-b9d7-24a1cb1f731d tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:18.677131 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-ea61afdc-c658-4832-b9d7-24a1cb1f731d tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:18.682975 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:18.684313 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=6 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:18.691808 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ea61afdc-c658-4832-b9d7-24a1cb1f731d tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:18.692370 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ea61afdc-c658-4832-b9d7-24a1cb1f731d tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:18.692878 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ea61afdc-c658-4832-b9d7-24a1cb1f731d tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:18.694035 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ea61afdc-c658-4832-b9d7-24a1cb1f731d tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:18.694470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ea61afdc-c658-4832-b9d7-24a1cb1f731d tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:18.695201 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-ea61afdc-c658-4832-b9d7-24a1cb1f731d tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:18.847787 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-ea61afdc-c658-4832-b9d7-24a1cb1f731d tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:18.851180 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:18.855849 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-ea61afdc-c658-4832-b9d7-24a1cb1f731d tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.190145 Aug 24 10:26:18.856766 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 477/961] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:18 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:19.879077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=8 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:19.883272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0f7f34dc-27a5-4bd6-a832-4209ebd72a4f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:19.883892 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0f7f34dc-27a5-4bd6-a832-4209ebd72a4f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:19.890196 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0f7f34dc-27a5-4bd6-a832-4209ebd72a4f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:19.890677 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0f7f34dc-27a5-4bd6-a832-4209ebd72a4f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:19.891139 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0f7f34dc-27a5-4bd6-a832-4209ebd72a4f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:19.891842 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0f7f34dc-27a5-4bd6-a832-4209ebd72a4f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:19.892341 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0f7f34dc-27a5-4bd6-a832-4209ebd72a4f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:19.893382 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0f7f34dc-27a5-4bd6-a832-4209ebd72a4f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:20.063081 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0f7f34dc-27a5-4bd6-a832-4209ebd72a4f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:20.076163 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0f7f34dc-27a5-4bd6-a832-4209ebd72a4f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.198261 Aug 24 10:26:20.076761 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 485/962] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:19 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:21.098670 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-10bfb9e2-b8f9-487b-833c-a7f63e812111 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:21.099304 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-10bfb9e2-b8f9-487b-833c-a7f63e812111 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:21.103652 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:21.108276 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10bfb9e2-b8f9-487b-833c-a7f63e812111 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:21.108774 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10bfb9e2-b8f9-487b-833c-a7f63e812111 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:21.109422 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10bfb9e2-b8f9-487b-833c-a7f63e812111 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:21.110253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10bfb9e2-b8f9-487b-833c-a7f63e812111 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:21.110800 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10bfb9e2-b8f9-487b-833c-a7f63e812111 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:21.115036 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-10bfb9e2-b8f9-487b-833c-a7f63e812111 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:21.273227 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-10bfb9e2-b8f9-487b-833c-a7f63e812111 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:21.292104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-10bfb9e2-b8f9-487b-833c-a7f63e812111 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.190682 Aug 24 10:26:21.292104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 478/963] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:21 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:22.306492 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a9606785-05e1-48a3-84e2-620cf69cf122 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:22.308381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a9606785-05e1-48a3-84e2-620cf69cf122 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:22.310101 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:22.317076 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a9606785-05e1-48a3-84e2-620cf69cf122 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:22.317575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a9606785-05e1-48a3-84e2-620cf69cf122 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:22.318016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a9606785-05e1-48a3-84e2-620cf69cf122 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:22.318724 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a9606785-05e1-48a3-84e2-620cf69cf122 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:22.319184 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a9606785-05e1-48a3-84e2-620cf69cf122 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:22.319615 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a9606785-05e1-48a3-84e2-620cf69cf122 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:22.323642 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=95 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:22.492781 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a9606785-05e1-48a3-84e2-620cf69cf122 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:22.500529 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a9606785-05e1-48a3-84e2-620cf69cf122 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.198723 Aug 24 10:26:22.502639 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 486/964] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:22 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:23.314722 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-ab35e6c5-4606-46f3-b037-07ab320ca352 req-bc4e2b16-b203-4ecb-bc48-7a86ab050b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fbc3df-348f-4e15-bb60-adef1d1ad97c", "tag": "9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:23.324573 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-ab35e6c5-4606-46f3-b037-07ab320ca352 req-bc4e2b16-b203-4ecb-bc48-7a86ab050b88 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:23.325068 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-ab35e6c5-4606-46f3-b037-07ab320ca352 req-bc4e2b16-b203-4ecb-bc48-7a86ab050b88 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:23.325488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-ab35e6c5-4606-46f3-b037-07ab320ca352 req-bc4e2b16-b203-4ecb-bc48-7a86ab050b88 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:23.337161 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-ab35e6c5-4606-46f3-b037-07ab320ca352 req-bc4e2b16-b203-4ecb-bc48-7a86ab050b88 service nova] Creating event network-changed:9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad for instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c on hv-cinder-85427 Aug 24 10:26:23.343030 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-ab35e6c5-4606-46f3-b037-07ab320ca352 req-bc4e2b16-b203-4ecb-bc48-7a86ab050b88 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032463 Aug 24 10:26:23.343637 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 479/965] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:23.526765 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d9bce6cc-b60c-42cb-938d-fa6b739a831f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:23.527546 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d9bce6cc-b60c-42cb-938d-fa6b739a831f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:23.541308 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d9bce6cc-b60c-42cb-938d-fa6b739a831f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:23.541308 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d9bce6cc-b60c-42cb-938d-fa6b739a831f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:23.541308 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d9bce6cc-b60c-42cb-938d-fa6b739a831f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:23.541308 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d9bce6cc-b60c-42cb-938d-fa6b739a831f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:23.541633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d9bce6cc-b60c-42cb-938d-fa6b739a831f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:23.541633 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d9bce6cc-b60c-42cb-938d-fa6b739a831f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:23.713791 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d9bce6cc-b60c-42cb-938d-fa6b739a831f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:23.722910 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d9bce6cc-b60c-42cb-938d-fa6b739a831f tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.201895 Aug 24 10:26:23.723799 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 487/966] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:23 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:24.747952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9155ef0e-28ea-4a3e-bbfe-ec8046d800f7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:24.747952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9155ef0e-28ea-4a3e-bbfe-ec8046d800f7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:24.753913 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9155ef0e-28ea-4a3e-bbfe-ec8046d800f7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:24.754394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9155ef0e-28ea-4a3e-bbfe-ec8046d800f7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:24.754909 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9155ef0e-28ea-4a3e-bbfe-ec8046d800f7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:24.755613 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9155ef0e-28ea-4a3e-bbfe-ec8046d800f7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:24.756066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9155ef0e-28ea-4a3e-bbfe-ec8046d800f7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:24.756493 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9155ef0e-28ea-4a3e-bbfe-ec8046d800f7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:24.904470 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9155ef0e-28ea-4a3e-bbfe-ec8046d800f7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:24.913803 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9155ef0e-28ea-4a3e-bbfe-ec8046d800f7 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.172693 Aug 24 10:26:24.914632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 480/967] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:24 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:25.935722 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3837c4eb-cd0a-4499-9b0f-f0b0cccf9486 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:25.936684 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3837c4eb-cd0a-4499-9b0f-f0b0cccf9486 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:25.944875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3837c4eb-cd0a-4499-9b0f-f0b0cccf9486 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:25.945374 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3837c4eb-cd0a-4499-9b0f-f0b0cccf9486 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:25.956305 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3837c4eb-cd0a-4499-9b0f-f0b0cccf9486 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:25.956305 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3837c4eb-cd0a-4499-9b0f-f0b0cccf9486 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:25.956305 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3837c4eb-cd0a-4499-9b0f-f0b0cccf9486 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:25.956305 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3837c4eb-cd0a-4499-9b0f-f0b0cccf9486 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:26.099670 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3837c4eb-cd0a-4499-9b0f-f0b0cccf9486 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:26.102539 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3837c4eb-cd0a-4499-9b0f-f0b0cccf9486 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.171007 Aug 24 10:26:26.103211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 488/968] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:25 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:27.125202 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-689c02b7-2b33-4ff6-ab1a-fa7f9c9d215a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:27.126524 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-689c02b7-2b33-4ff6-ab1a-fa7f9c9d215a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:27.134397 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-689c02b7-2b33-4ff6-ab1a-fa7f9c9d215a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:27.135514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-689c02b7-2b33-4ff6-ab1a-fa7f9c9d215a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:27.135514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-689c02b7-2b33-4ff6-ab1a-fa7f9c9d215a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:27.136833 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-689c02b7-2b33-4ff6-ab1a-fa7f9c9d215a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:27.137109 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-689c02b7-2b33-4ff6-ab1a-fa7f9c9d215a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:27.137583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-689c02b7-2b33-4ff6-ab1a-fa7f9c9d215a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:27.281290 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-689c02b7-2b33-4ff6-ab1a-fa7f9c9d215a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:27.289932 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-689c02b7-2b33-4ff6-ab1a-fa7f9c9d215a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.168836 Aug 24 10:26:27.290543 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 481/969] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:27 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:28.318638 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e053041c-6a79-45cc-9636-828f1857eb15 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:28.319768 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e053041c-6a79-45cc-9636-828f1857eb15 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:28.330601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e053041c-6a79-45cc-9636-828f1857eb15 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:28.331472 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e053041c-6a79-45cc-9636-828f1857eb15 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:28.332207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e053041c-6a79-45cc-9636-828f1857eb15 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:28.333518 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e053041c-6a79-45cc-9636-828f1857eb15 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:28.334389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e053041c-6a79-45cc-9636-828f1857eb15 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:28.335144 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e053041c-6a79-45cc-9636-828f1857eb15 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:28.473645 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e053041c-6a79-45cc-9636-828f1857eb15 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:28.481641 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e053041c-6a79-45cc-9636-828f1857eb15 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.173471 Aug 24 10:26:28.482207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 489/970] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:28 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:29.279124 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-d5d0d7ed-af88-40d2-be12-8fc7fc19d9a8 req-be525d04-d6a2-48cb-9b0e-3ec22f197173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fbc3df-348f-4e15-bb60-adef1d1ad97c", "name": "network-vif-plugged", "status": "completed", "tag": "9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:29.289741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-d5d0d7ed-af88-40d2-be12-8fc7fc19d9a8 req-be525d04-d6a2-48cb-9b0e-3ec22f197173 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:29.290213 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-d5d0d7ed-af88-40d2-be12-8fc7fc19d9a8 req-be525d04-d6a2-48cb-9b0e-3ec22f197173 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:29.290710 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-d5d0d7ed-af88-40d2-be12-8fc7fc19d9a8 req-be525d04-d6a2-48cb-9b0e-3ec22f197173 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:29.302321 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-d5d0d7ed-af88-40d2-be12-8fc7fc19d9a8 req-be525d04-d6a2-48cb-9b0e-3ec22f197173 service nova] Creating event network-vif-plugged:9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad for instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c on hv-cinder-85427 Aug 24 10:26:29.307572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-d5d0d7ed-af88-40d2-be12-8fc7fc19d9a8 req-be525d04-d6a2-48cb-9b0e-3ec22f197173 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032311 Aug 24 10:26:29.311020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 482/971] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:29.502857 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-35874446-ffd8-4e46-a563-e1714e5ec469 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:29.504091 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-35874446-ffd8-4e46-a563-e1714e5ec469 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:29.510567 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35874446-ffd8-4e46-a563-e1714e5ec469 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:29.511050 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35874446-ffd8-4e46-a563-e1714e5ec469 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:29.511496 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35874446-ffd8-4e46-a563-e1714e5ec469 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:29.512193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35874446-ffd8-4e46-a563-e1714e5ec469 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:29.512648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35874446-ffd8-4e46-a563-e1714e5ec469 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:29.513095 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-35874446-ffd8-4e46-a563-e1714e5ec469 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:29.655766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-35874446-ffd8-4e46-a563-e1714e5ec469 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:29.663525 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-35874446-ffd8-4e46-a563-e1714e5ec469 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.164598 Aug 24 10:26:29.664114 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 490/972] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:29 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:30.644288 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-54de020e-7ae6-467e-865c-5d2bd3221801 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a3131e4-b55e-4fe2-b441-7d3f8e456541", "device": "/dev/sdb"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:30.647341 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-54de020e-7ae6-467e-865c-5d2bd3221801 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:30.653556 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54de020e-7ae6-467e-865c-5d2bd3221801 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:30.654035 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54de020e-7ae6-467e-865c-5d2bd3221801 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:30.654472 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54de020e-7ae6-467e-865c-5d2bd3221801 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:30.655163 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54de020e-7ae6-467e-865c-5d2bd3221801 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:30.655611 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54de020e-7ae6-467e-865c-5d2bd3221801 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:30.656034 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-54de020e-7ae6-467e-865c-5d2bd3221801 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:30.686744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-faba0f3d-c77b-424f-ab3f-439589b1ca3b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:30.687386 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-faba0f3d-c77b-424f-ab3f-439589b1ca3b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:30.696104 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-faba0f3d-c77b-424f-ab3f-439589b1ca3b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:30.696597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-faba0f3d-c77b-424f-ab3f-439589b1ca3b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:30.697085 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-faba0f3d-c77b-424f-ab3f-439589b1ca3b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:30.698033 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-faba0f3d-c77b-424f-ab3f-439589b1ca3b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:30.698356 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-faba0f3d-c77b-424f-ab3f-439589b1ca3b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:30.699002 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-faba0f3d-c77b-424f-ab3f-439589b1ca3b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:30.839348 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-faba0f3d-c77b-424f-ab3f-439589b1ca3b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:30.846866 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-faba0f3d-c77b-424f-ab3f-439589b1ca3b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1358 microversion: 2.1 time: 0.166315 Aug 24 10:26:30.847424 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 491/973] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:30 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:31.868208 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-320c72b8-c83b-48d6-9003-433d1a786691 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:31.869305 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-320c72b8-c83b-48d6-9003-433d1a786691 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:31.875222 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-320c72b8-c83b-48d6-9003-433d1a786691 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:31.892756 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-320c72b8-c83b-48d6-9003-433d1a786691 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:31.892756 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-320c72b8-c83b-48d6-9003-433d1a786691 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:31.892756 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-320c72b8-c83b-48d6-9003-433d1a786691 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:31.892756 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-320c72b8-c83b-48d6-9003-433d1a786691 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:31.893926 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-320c72b8-c83b-48d6-9003-433d1a786691 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:32.009688 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-320c72b8-c83b-48d6-9003-433d1a786691 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:32.017584 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-320c72b8-c83b-48d6-9003-433d1a786691 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1548 microversion: 2.1 time: 0.153232 Aug 24 10:26:32.018154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 492/974] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:31 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:32.039022 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0776310a-33df-4903-8242-1aa15e5dae64 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:32.039651 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0776310a-33df-4903-8242-1aa15e5dae64 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:32.045802 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0776310a-33df-4903-8242-1aa15e5dae64 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:32.049814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0776310a-33df-4903-8242-1aa15e5dae64 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:32.049814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0776310a-33df-4903-8242-1aa15e5dae64 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:32.049814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0776310a-33df-4903-8242-1aa15e5dae64 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:32.049814 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0776310a-33df-4903-8242-1aa15e5dae64 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:32.050792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0776310a-33df-4903-8242-1aa15e5dae64 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:32.184688 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0776310a-33df-4903-8242-1aa15e5dae64 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:32.193182 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0776310a-33df-4903-8242-1aa15e5dae64 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1548 microversion: 2.1 time: 0.157910 Aug 24 10:26:32.193761 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 493/975] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:32 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:32.213337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:32.218170 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:32.218949 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Searching by: {'deleted': False, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b'} {{(pid=121271) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:26:32.226525 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:32.227068 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:32.227508 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:32.228243 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:32.229191 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:32.229191 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:32.305645 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-54de020e-7ae6-467e-865c-5d2bd3221801 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "POST /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.666615 Aug 24 10:26:32.307488 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 483/976] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:26:30 2022] POST /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a/os-volume_attachments => generated 194 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:32.329112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.multi_cell_list [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121271) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:26:32.439737 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-70e816fb-f944-4a30-9506-67a83243de7c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.230130 Aug 24 10:26:32.440712 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 494/977] 10.222.0.30 () {58 vars in 1125 bytes} [Wed Aug 24 10:26:32 2022] GET /compute/v2.1/servers => generated 343 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:26:32.457497 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c3515d91-579e-4547-aaa6-180bee6be03a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:32.458213 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c3515d91-579e-4547-aaa6-180bee6be03a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:32.464529 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c3515d91-579e-4547-aaa6-180bee6be03a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:32.465045 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c3515d91-579e-4547-aaa6-180bee6be03a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:32.465473 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c3515d91-579e-4547-aaa6-180bee6be03a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:32.466154 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c3515d91-579e-4547-aaa6-180bee6be03a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:32.466602 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c3515d91-579e-4547-aaa6-180bee6be03a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:32.467020 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c3515d91-579e-4547-aaa6-180bee6be03a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:32.607582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c3515d91-579e-4547-aaa6-180bee6be03a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:32.618542 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c3515d91-579e-4547-aaa6-180bee6be03a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1548 microversion: 2.1 time: 0.168846 Aug 24 10:26:32.619289 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 484/978] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:32 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:34.746289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2ece63e0-f576-487e-a0a0-0443f3d688ec tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb1846f8-b656-4bae-8e72-609fe9275f8d"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:34.748751 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2ece63e0-f576-487e-a0a0-0443f3d688ec tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:34.755789 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ece63e0-f576-487e-a0a0-0443f3d688ec tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:34.756274 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ece63e0-f576-487e-a0a0-0443f3d688ec tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:34.756711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ece63e0-f576-487e-a0a0-0443f3d688ec tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:34.757436 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ece63e0-f576-487e-a0a0-0443f3d688ec tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:34.758271 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ece63e0-f576-487e-a0a0-0443f3d688ec tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:34.758475 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2ece63e0-f576-487e-a0a0-0443f3d688ec tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:35.315094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2008934724", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:35.371983 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] validate_networks() for None {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:26:35.656067 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:26:35.656668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:26:35.657261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:26:35.657679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:26:35.658447 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:26:35.667761 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:35.668253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:35.668705 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:35.669474 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:35.669933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:35.670358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:35.681895 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2ece63e0-f576-487e-a0a0-0443f3d688ec tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "POST /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.939404 Aug 24 10:26:35.688090 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 495/979] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:26:34 2022] POST /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:35.692747 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Getting quotas for project ab68ba80c53149e8b13154db35c4e2c2. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:26:35.698172 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Getting quotas for user 6257debf16864da8ab702ad8092bd888 and project ab68ba80c53149e8b13154db35c4e2c2. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:26:35.710419 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:26:35.713854 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:26:35.868323 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-57834728-6d79-4508-b938-133d65462b5f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557068 Aug 24 10:26:35.868974 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 485/980] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:26:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:26:35.880587 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a9f3cea2-3e5c-41bb-b83b-4328327669a7 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:35.881324 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a9f3cea2-3e5c-41bb-b83b-4328327669a7 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:35.938358 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a9f3cea2-3e5c-41bb-b83b-4328327669a7 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:35.946361 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a9f3cea2-3e5c-41bb-b83b-4328327669a7 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1215 microversion: 2.1 time: 0.070216 Aug 24 10:26:35.946935 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 496/981] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:35 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:36.968194 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-40dcc03d-252d-42b1-ad0c-ffaa3411efd4 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:36.968736 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-40dcc03d-252d-42b1-ad0c-ffaa3411efd4 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:37.026395 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-40dcc03d-252d-42b1-ad0c-ffaa3411efd4 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:37.034297 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-40dcc03d-252d-42b1-ad0c-ffaa3411efd4 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1215 microversion: 2.1 time: 0.070371 Aug 24 10:26:37.035543 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 486/982] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:36 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:38.056169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-97368753-7456-4d85-b5a5-fa936c017d25 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:38.056873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-97368753-7456-4d85-b5a5-fa936c017d25 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:38.064181 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97368753-7456-4d85-b5a5-fa936c017d25 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:38.064669 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97368753-7456-4d85-b5a5-fa936c017d25 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:38.065680 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97368753-7456-4d85-b5a5-fa936c017d25 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:38.066436 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97368753-7456-4d85-b5a5-fa936c017d25 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:38.066924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97368753-7456-4d85-b5a5-fa936c017d25 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:38.067354 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-97368753-7456-4d85-b5a5-fa936c017d25 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:38.129780 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-97368753-7456-4d85-b5a5-fa936c017d25 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:38.137550 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-97368753-7456-4d85-b5a5-fa936c017d25 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1267 microversion: 2.1 time: 0.085496 Aug 24 10:26:38.138123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 497/983] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:38 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:39.163948 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3a1b8bac-2bc5-4c83-ac6f-ac754ca2ff9a tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:39.164531 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3a1b8bac-2bc5-4c83-ac6f-ac754ca2ff9a tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:39.172043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a1b8bac-2bc5-4c83-ac6f-ac754ca2ff9a tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:39.172533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a1b8bac-2bc5-4c83-ac6f-ac754ca2ff9a tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:39.173002 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a1b8bac-2bc5-4c83-ac6f-ac754ca2ff9a tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:39.174000 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a1b8bac-2bc5-4c83-ac6f-ac754ca2ff9a tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:39.174898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a1b8bac-2bc5-4c83-ac6f-ac754ca2ff9a tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:39.175900 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3a1b8bac-2bc5-4c83-ac6f-ac754ca2ff9a tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:39.255490 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3a1b8bac-2bc5-4c83-ac6f-ac754ca2ff9a tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:39.266311 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3a1b8bac-2bc5-4c83-ac6f-ac754ca2ff9a tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1273 microversion: 2.1 time: 0.110497 Aug 24 10:26:39.267217 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 487/984] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:39 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:40.287730 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0622a5bf-73ff-4859-bb24-17640fdbbb90 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:40.288339 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0622a5bf-73ff-4859-bb24-17640fdbbb90 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:40.294960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0622a5bf-73ff-4859-bb24-17640fdbbb90 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:40.295440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0622a5bf-73ff-4859-bb24-17640fdbbb90 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:40.296077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0622a5bf-73ff-4859-bb24-17640fdbbb90 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:40.296775 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0622a5bf-73ff-4859-bb24-17640fdbbb90 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:40.297282 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0622a5bf-73ff-4859-bb24-17640fdbbb90 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:40.297711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0622a5bf-73ff-4859-bb24-17640fdbbb90 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:40.433753 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0622a5bf-73ff-4859-bb24-17640fdbbb90 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:40.442790 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0622a5bf-73ff-4859-bb24-17640fdbbb90 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.159006 Aug 24 10:26:40.443392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 498/985] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:40 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:40.716445 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-41e716fc-7b9a-40fc-adb9-282045d5d912 req-a5093c10-1d55-4146-b40f-93bd624b4b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4241f7e1-0137-48d8-91d2-04537e780493", "tag": "144e137f-93ac-4030-b5ac-a42e8f6460ec"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:40.727443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-41e716fc-7b9a-40fc-adb9-282045d5d912 req-a5093c10-1d55-4146-b40f-93bd624b4b35 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:40.727916 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-41e716fc-7b9a-40fc-adb9-282045d5d912 req-a5093c10-1d55-4146-b40f-93bd624b4b35 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:40.728344 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-41e716fc-7b9a-40fc-adb9-282045d5d912 req-a5093c10-1d55-4146-b40f-93bd624b4b35 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:40.741246 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-41e716fc-7b9a-40fc-adb9-282045d5d912 req-a5093c10-1d55-4146-b40f-93bd624b4b35 service nova] Creating event network-changed:144e137f-93ac-4030-b5ac-a42e8f6460ec for instance 4241f7e1-0137-48d8-91d2-04537e780493 on hv-cinder-85427 Aug 24 10:26:40.746828 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-41e716fc-7b9a-40fc-adb9-282045d5d912 req-a5093c10-1d55-4146-b40f-93bd624b4b35 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033915 Aug 24 10:26:40.747388 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 488/986] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:41.463766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-1c6ca440-fd89-4c5b-a951-a1298200dc75 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:41.464386 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-1c6ca440-fd89-4c5b-a951-a1298200dc75 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:41.471171 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c6ca440-fd89-4c5b-a951-a1298200dc75 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:41.472459 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c6ca440-fd89-4c5b-a951-a1298200dc75 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:41.472928 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c6ca440-fd89-4c5b-a951-a1298200dc75 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:41.473639 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c6ca440-fd89-4c5b-a951-a1298200dc75 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:41.474183 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c6ca440-fd89-4c5b-a951-a1298200dc75 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:41.474640 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-1c6ca440-fd89-4c5b-a951-a1298200dc75 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:41.614593 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-1c6ca440-fd89-4c5b-a951-a1298200dc75 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:41.623896 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-1c6ca440-fd89-4c5b-a951-a1298200dc75 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.163983 Aug 24 10:26:41.626998 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 499/987] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:41 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:42.645820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1fec0238-fc7c-4bdd-825d-60b21b105a52 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:42.646527 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1fec0238-fc7c-4bdd-825d-60b21b105a52 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:42.653273 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1fec0238-fc7c-4bdd-825d-60b21b105a52 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:42.653754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1fec0238-fc7c-4bdd-825d-60b21b105a52 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:42.654194 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1fec0238-fc7c-4bdd-825d-60b21b105a52 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:42.654889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1fec0238-fc7c-4bdd-825d-60b21b105a52 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:42.655344 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1fec0238-fc7c-4bdd-825d-60b21b105a52 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:42.655770 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1fec0238-fc7c-4bdd-825d-60b21b105a52 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:42.785496 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1fec0238-fc7c-4bdd-825d-60b21b105a52 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:42.793405 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1fec0238-fc7c-4bdd-825d-60b21b105a52 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.151668 Aug 24 10:26:42.793910 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 489/988] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:42 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:43.820474 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c4b032a4-60c5-454e-a85f-4d6f5419af3f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:43.820474 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c4b032a4-60c5-454e-a85f-4d6f5419af3f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:43.820474 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:43.822875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4b032a4-60c5-454e-a85f-4d6f5419af3f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:43.823351 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4b032a4-60c5-454e-a85f-4d6f5419af3f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:43.823786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4b032a4-60c5-454e-a85f-4d6f5419af3f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:43.824470 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4b032a4-60c5-454e-a85f-4d6f5419af3f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:43.824938 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4b032a4-60c5-454e-a85f-4d6f5419af3f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:43.825358 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c4b032a4-60c5-454e-a85f-4d6f5419af3f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:43.954404 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-c4b032a4-60c5-454e-a85f-4d6f5419af3f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:43.962363 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c4b032a4-60c5-454e-a85f-4d6f5419af3f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.151688 Aug 24 10:26:43.962934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 500/989] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:43 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:44.984345 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9d2a7859-a64e-4c5e-9ce6-ba27b8aebdd2 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:44.985587 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9d2a7859-a64e-4c5e-9ce6-ba27b8aebdd2 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:44.992172 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d2a7859-a64e-4c5e-9ce6-ba27b8aebdd2 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:44.992650 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d2a7859-a64e-4c5e-9ce6-ba27b8aebdd2 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:44.993137 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d2a7859-a64e-4c5e-9ce6-ba27b8aebdd2 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:44.993834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d2a7859-a64e-4c5e-9ce6-ba27b8aebdd2 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:44.994281 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d2a7859-a64e-4c5e-9ce6-ba27b8aebdd2 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:44.994720 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d2a7859-a64e-4c5e-9ce6-ba27b8aebdd2 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:45.131621 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9d2a7859-a64e-4c5e-9ce6-ba27b8aebdd2 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:45.139584 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9d2a7859-a64e-4c5e-9ce6-ba27b8aebdd2 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.159408 Aug 24 10:26:45.140152 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 490/990] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:44 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:46.161466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-18531c39-d8df-4de9-89db-2d4c72980fb5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:46.162234 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-18531c39-d8df-4de9-89db-2d4c72980fb5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:46.164565 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:46.169473 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18531c39-d8df-4de9-89db-2d4c72980fb5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:46.169961 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18531c39-d8df-4de9-89db-2d4c72980fb5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:46.170440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18531c39-d8df-4de9-89db-2d4c72980fb5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:46.172696 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18531c39-d8df-4de9-89db-2d4c72980fb5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:46.172696 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18531c39-d8df-4de9-89db-2d4c72980fb5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:46.172696 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-18531c39-d8df-4de9-89db-2d4c72980fb5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:46.308276 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-18531c39-d8df-4de9-89db-2d4c72980fb5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:46.321274 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-18531c39-d8df-4de9-89db-2d4c72980fb5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.164355 Aug 24 10:26:46.321900 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 501/991] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:46 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:47.342939 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bb80edf8-0f97-4a5b-ab34-b9be50f64102 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:47.343582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bb80edf8-0f97-4a5b-ab34-b9be50f64102 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:47.347232 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:47.348351 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=8 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:47.352064 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb80edf8-0f97-4a5b-ab34-b9be50f64102 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:47.352564 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb80edf8-0f97-4a5b-ab34-b9be50f64102 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:47.353008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb80edf8-0f97-4a5b-ab34-b9be50f64102 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:47.353712 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb80edf8-0f97-4a5b-ab34-b9be50f64102 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:47.360220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb80edf8-0f97-4a5b-ab34-b9be50f64102 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:47.360220 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bb80edf8-0f97-4a5b-ab34-b9be50f64102 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:47.485144 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-bb80edf8-0f97-4a5b-ab34-b9be50f64102 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:47.493135 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bb80edf8-0f97-4a5b-ab34-b9be50f64102 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.154285 Aug 24 10:26:47.493708 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 491/992] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:47 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:48.513794 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-63af2bec-ec84-4465-acc6-cfd4516e9015 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:48.514411 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-63af2bec-ec84-4465-acc6-cfd4516e9015 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:48.520784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-63af2bec-ec84-4465-acc6-cfd4516e9015 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:48.521303 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-63af2bec-ec84-4465-acc6-cfd4516e9015 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:48.521747 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-63af2bec-ec84-4465-acc6-cfd4516e9015 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:48.522461 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-63af2bec-ec84-4465-acc6-cfd4516e9015 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:48.522905 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-63af2bec-ec84-4465-acc6-cfd4516e9015 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:48.523333 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-63af2bec-ec84-4465-acc6-cfd4516e9015 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:48.527307 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:48.653771 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-63af2bec-ec84-4465-acc6-cfd4516e9015 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:48.661704 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-63af2bec-ec84-4465-acc6-cfd4516e9015 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.151777 Aug 24 10:26:48.662255 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 502/993] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:48 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:49.682811 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-076ee43f-40d5-4cc0-a85c-8469fc48cfff tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:49.683419 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-076ee43f-40d5-4cc0-a85c-8469fc48cfff tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:49.689841 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-076ee43f-40d5-4cc0-a85c-8469fc48cfff tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:49.690372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-076ee43f-40d5-4cc0-a85c-8469fc48cfff tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:49.690797 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-076ee43f-40d5-4cc0-a85c-8469fc48cfff tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:49.691481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-076ee43f-40d5-4cc0-a85c-8469fc48cfff tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:49.692006 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-076ee43f-40d5-4cc0-a85c-8469fc48cfff tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:49.692423 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-076ee43f-40d5-4cc0-a85c-8469fc48cfff tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:49.826701 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-076ee43f-40d5-4cc0-a85c-8469fc48cfff tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:49.835259 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-076ee43f-40d5-4cc0-a85c-8469fc48cfff tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.156382 Aug 24 10:26:49.835826 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 492/994] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:49 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:50.804124 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bf9933f8-dc8b-4760-8c65-c3759906ffe9 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:50.804124 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bf9933f8-dc8b-4760-8c65-c3759906ffe9 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:50.809750 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf9933f8-dc8b-4760-8c65-c3759906ffe9 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:50.810235 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf9933f8-dc8b-4760-8c65-c3759906ffe9 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:50.810669 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf9933f8-dc8b-4760-8c65-c3759906ffe9 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:50.811398 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf9933f8-dc8b-4760-8c65-c3759906ffe9 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:50.811850 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf9933f8-dc8b-4760-8c65-c3759906ffe9 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:50.812335 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bf9933f8-dc8b-4760-8c65-c3759906ffe9 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:50.857334 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-cae4f0ce-45fa-4936-937b-69070db84213 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:50.858108 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-cae4f0ce-45fa-4936-937b-69070db84213 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:50.865536 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cae4f0ce-45fa-4936-937b-69070db84213 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:50.866024 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cae4f0ce-45fa-4936-937b-69070db84213 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:50.866456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cae4f0ce-45fa-4936-937b-69070db84213 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:50.867287 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cae4f0ce-45fa-4936-937b-69070db84213 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:50.867658 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cae4f0ce-45fa-4936-937b-69070db84213 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:50.868114 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-cae4f0ce-45fa-4936-937b-69070db84213 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:51.005641 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-cae4f0ce-45fa-4936-937b-69070db84213 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:51.014344 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-cae4f0ce-45fa-4936-937b-69070db84213 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.161077 Aug 24 10:26:51.014949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 493/995] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:50 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:51.212756 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-bf9933f8-dc8b-4760-8c65-c3759906ffe9 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:51.222128 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bf9933f8-dc8b-4760-8c65-c3759906ffe9 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1594 microversion: 2.1 time: 0.424062 Aug 24 10:26:51.222709 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 503/996] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:50 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1594 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:52.035985 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c67eee7e-2c3d-4e20-870a-f9f883e4b3f5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:52.036598 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c67eee7e-2c3d-4e20-870a-f9f883e4b3f5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:52.042934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c67eee7e-2c3d-4e20-870a-f9f883e4b3f5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:52.043415 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c67eee7e-2c3d-4e20-870a-f9f883e4b3f5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:52.043852 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c67eee7e-2c3d-4e20-870a-f9f883e4b3f5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:52.044545 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c67eee7e-2c3d-4e20-870a-f9f883e4b3f5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:52.045024 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c67eee7e-2c3d-4e20-870a-f9f883e4b3f5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:52.045552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c67eee7e-2c3d-4e20-870a-f9f883e4b3f5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:52.048059 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:52.207395 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c67eee7e-2c3d-4e20-870a-f9f883e4b3f5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:52.216593 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c67eee7e-2c3d-4e20-870a-f9f883e4b3f5 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.184665 Aug 24 10:26:52.217308 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 494/997] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:52 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:52.318702 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-d9815cff-19cb-467e-9197-c2b49d75768c req-a90212d7-2c7e-4d8b-bfb8-69fb175e6f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4241f7e1-0137-48d8-91d2-04537e780493", "name": "network-vif-plugged", "status": "completed", "tag": "144e137f-93ac-4030-b5ac-a42e8f6460ec"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:52.330706 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d9815cff-19cb-467e-9197-c2b49d75768c req-a90212d7-2c7e-4d8b-bfb8-69fb175e6f67 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:52.330706 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d9815cff-19cb-467e-9197-c2b49d75768c req-a90212d7-2c7e-4d8b-bfb8-69fb175e6f67 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:52.330706 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d9815cff-19cb-467e-9197-c2b49d75768c req-a90212d7-2c7e-4d8b-bfb8-69fb175e6f67 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:52.342033 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-d9815cff-19cb-467e-9197-c2b49d75768c req-a90212d7-2c7e-4d8b-bfb8-69fb175e6f67 service nova] Creating event network-vif-plugged:144e137f-93ac-4030-b5ac-a42e8f6460ec for instance 4241f7e1-0137-48d8-91d2-04537e780493 on hv-cinder-85427 Aug 24 10:26:52.347584 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-d9815cff-19cb-467e-9197-c2b49d75768c req-a90212d7-2c7e-4d8b-bfb8-69fb175e6f67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 Aug 24 10:26:52.348218 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 504/998] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:53.242276 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-459f2963-53d6-4cbc-8b61-dfedb7bfd3b9 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:53.242902 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-459f2963-53d6-4cbc-8b61-dfedb7bfd3b9 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:53.249821 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-459f2963-53d6-4cbc-8b61-dfedb7bfd3b9 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:53.250306 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-459f2963-53d6-4cbc-8b61-dfedb7bfd3b9 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:53.250745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-459f2963-53d6-4cbc-8b61-dfedb7bfd3b9 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:53.251456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-459f2963-53d6-4cbc-8b61-dfedb7bfd3b9 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:53.251913 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-459f2963-53d6-4cbc-8b61-dfedb7bfd3b9 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:53.252339 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-459f2963-53d6-4cbc-8b61-dfedb7bfd3b9 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:53.387999 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-459f2963-53d6-4cbc-8b61-dfedb7bfd3b9 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:53.396790 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-459f2963-53d6-4cbc-8b61-dfedb7bfd3b9 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.159342 Aug 24 10:26:53.397400 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 495/999] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:53 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:53.694482 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-d60ae783-b248-45db-8216-949a971cb082 req-5cb57224-1108-4506-b9f4-c9f1c0b281af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fbc3df-348f-4e15-bb60-adef1d1ad97c", "tag": "9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:53.705919 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d60ae783-b248-45db-8216-949a971cb082 req-5cb57224-1108-4506-b9f4-c9f1c0b281af service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:53.706477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d60ae783-b248-45db-8216-949a971cb082 req-5cb57224-1108-4506-b9f4-c9f1c0b281af service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:53.706987 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d60ae783-b248-45db-8216-949a971cb082 req-5cb57224-1108-4506-b9f4-c9f1c0b281af service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:53.720459 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-d60ae783-b248-45db-8216-949a971cb082 req-5cb57224-1108-4506-b9f4-c9f1c0b281af service nova] Creating event network-changed:9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad for instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c on hv-cinder-85427 Aug 24 10:26:53.726231 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-d60ae783-b248-45db-8216-949a971cb082 req-5cb57224-1108-4506-b9f4-c9f1c0b281af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201776 Aug 24 10:26:53.727068 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 505/1000] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:54.421611 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0f1340a3-9cfc-4d74-9859-dee94a44d31f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:54.422224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0f1340a3-9cfc-4d74-9859-dee94a44d31f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:54.431608 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f1340a3-9cfc-4d74-9859-dee94a44d31f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:54.432104 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f1340a3-9cfc-4d74-9859-dee94a44d31f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:54.432532 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f1340a3-9cfc-4d74-9859-dee94a44d31f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:54.433486 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f1340a3-9cfc-4d74-9859-dee94a44d31f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:54.433936 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f1340a3-9cfc-4d74-9859-dee94a44d31f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:54.434356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f1340a3-9cfc-4d74-9859-dee94a44d31f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:54.644045 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0f1340a3-9cfc-4d74-9859-dee94a44d31f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:54.652141 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0f1340a3-9cfc-4d74-9859-dee94a44d31f tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.234385 Aug 24 10:26:54.652698 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 496/1001] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:54 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:55.674758 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-94a855d4-340f-47cb-838f-988e2de1281b tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:55.675470 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-94a855d4-340f-47cb-838f-988e2de1281b tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:55.684475 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-94a855d4-340f-47cb-838f-988e2de1281b tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:55.685003 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-94a855d4-340f-47cb-838f-988e2de1281b tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:55.685442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-94a855d4-340f-47cb-838f-988e2de1281b tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:55.686146 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-94a855d4-340f-47cb-838f-988e2de1281b tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:55.686589 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-94a855d4-340f-47cb-838f-988e2de1281b tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:55.687009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-94a855d4-340f-47cb-838f-988e2de1281b tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:55.948421 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-94a855d4-340f-47cb-838f-988e2de1281b tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:55.956235 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-94a855d4-340f-47cb-838f-988e2de1281b tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.287187 Aug 24 10:26:55.956833 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 506/1002] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:55 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:56.731019 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a3b266ea-aa26-4203-bc64-26c095491bb4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-328704070"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:56.731591 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a3b266ea-aa26-4203-bc64-26c095491bb4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:56.733926 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:56.738749 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3b266ea-aa26-4203-bc64-26c095491bb4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:56.739238 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3b266ea-aa26-4203-bc64-26c095491bb4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:56.739698 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3b266ea-aa26-4203-bc64-26c095491bb4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:56.740377 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3b266ea-aa26-4203-bc64-26c095491bb4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:56.740836 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3b266ea-aa26-4203-bc64-26c095491bb4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:56.741288 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a3b266ea-aa26-4203-bc64-26c095491bb4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:56.956067 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.network.security_group_api [None req-a3b266ea-aa26-4203-bc64-26c095491bb4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Adding security group f907c2e9-4fe9-4368-8053-045187d4d884 to port 9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad Aug 24 10:26:56.977341 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bb3606de-b48d-4538-85f8-54800e63889c tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:56.977896 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bb3606de-b48d-4538-85f8-54800e63889c tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:56.980621 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=44 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:26:56.985403 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb3606de-b48d-4538-85f8-54800e63889c tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:56.985882 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb3606de-b48d-4538-85f8-54800e63889c tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:56.986417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb3606de-b48d-4538-85f8-54800e63889c tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:56.987201 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb3606de-b48d-4538-85f8-54800e63889c tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:56.987654 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb3606de-b48d-4538-85f8-54800e63889c tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:56.988075 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bb3606de-b48d-4538-85f8-54800e63889c tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:57.122932 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-bb3606de-b48d-4538-85f8-54800e63889c tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:57.131875 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bb3606de-b48d-4538-85f8-54800e63889c tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1315 microversion: 2.1 time: 0.158393 Aug 24 10:26:57.132456 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 507/1003] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:56 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:57.480050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a3b266ea-aa26-4203-bc64-26c095491bb4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "POST /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/action" status: 202 len: 0 microversion: 2.1 time: 0.751840 Aug 24 10:26:57.480050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 497/1004] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:26:56 2022] POST /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/action => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:26:57.488623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-74695975-a8c0-43f8-9b67-e9a22d382839 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:57.488834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-0d505251-0995-4c72-907c-7889f377ad82 req-ce214698-cad5-442d-a34f-cc40a46c84bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fbc3df-348f-4e15-bb60-adef1d1ad97c", "tag": "9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:26:57.489289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-74695975-a8c0-43f8-9b67-e9a22d382839 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:57.495755 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74695975-a8c0-43f8-9b67-e9a22d382839 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:57.496715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74695975-a8c0-43f8-9b67-e9a22d382839 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:57.496715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74695975-a8c0-43f8-9b67-e9a22d382839 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:57.497410 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74695975-a8c0-43f8-9b67-e9a22d382839 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:57.497869 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74695975-a8c0-43f8-9b67-e9a22d382839 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:57.498262 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-0d505251-0995-4c72-907c-7889f377ad82 req-ce214698-cad5-442d-a34f-cc40a46c84bc service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:57.498386 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-74695975-a8c0-43f8-9b67-e9a22d382839 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:57.498736 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-0d505251-0995-4c72-907c-7889f377ad82 req-ce214698-cad5-442d-a34f-cc40a46c84bc service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:57.499500 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-0d505251-0995-4c72-907c-7889f377ad82 req-ce214698-cad5-442d-a34f-cc40a46c84bc service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:57.511935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-0d505251-0995-4c72-907c-7889f377ad82 req-ce214698-cad5-442d-a34f-cc40a46c84bc service nova] Creating event network-changed:9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad for instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c on hv-cinder-85427 Aug 24 10:26:57.517842 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-0d505251-0995-4c72-907c-7889f377ad82 req-ce214698-cad5-442d-a34f-cc40a46c84bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033232 Aug 24 10:26:57.521973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 498/1005] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:26:57.656221 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-74695975-a8c0-43f8-9b67-e9a22d382839 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:57.665677 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-74695975-a8c0-43f8-9b67-e9a22d382839 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1759 microversion: 2.1 time: 0.181810 Aug 24 10:26:57.666272 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 508/1006] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:57 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:58.154875 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c205a4e4-4a3b-4f0a-a3b0-fc5e9cabf305 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:58.155802 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c205a4e4-4a3b-4f0a-a3b0-fc5e9cabf305 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:58.163951 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c205a4e4-4a3b-4f0a-a3b0-fc5e9cabf305 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:58.164504 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c205a4e4-4a3b-4f0a-a3b0-fc5e9cabf305 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:58.164993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c205a4e4-4a3b-4f0a-a3b0-fc5e9cabf305 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:58.166032 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c205a4e4-4a3b-4f0a-a3b0-fc5e9cabf305 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:58.166301 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c205a4e4-4a3b-4f0a-a3b0-fc5e9cabf305 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:58.166982 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c205a4e4-4a3b-4f0a-a3b0-fc5e9cabf305 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:58.386037 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c205a4e4-4a3b-4f0a-a3b0-fc5e9cabf305 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:58.394428 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c205a4e4-4a3b-4f0a-a3b0-fc5e9cabf305 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1464 microversion: 2.1 time: 0.246425 Aug 24 10:26:58.395013 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 499/1007] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:58 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1464 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:26:58.440520 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-44393942-3aee-40fb-b75f-d933e5e78d24 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:58.441213 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-44393942-3aee-40fb-b75f-d933e5e78d24 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:58.447835 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44393942-3aee-40fb-b75f-d933e5e78d24 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:58.448351 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44393942-3aee-40fb-b75f-d933e5e78d24 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:58.448791 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44393942-3aee-40fb-b75f-d933e5e78d24 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:58.449527 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44393942-3aee-40fb-b75f-d933e5e78d24 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:58.449982 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44393942-3aee-40fb-b75f-d933e5e78d24 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:58.450418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44393942-3aee-40fb-b75f-d933e5e78d24 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:58.486611 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-44393942-3aee-40fb-b75f-d933e5e78d24 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:26:59.014447 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-44393942-3aee-40fb-b75f-d933e5e78d24 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 204 len: 0 microversion: 2.1 time: 0.578123 Aug 24 10:26:59.015247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 509/1008] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:26:58 2022] DELETE /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:26:59.023705 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c8666cbe-77ba-483c-8d3e-f95fc4fe493e tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:59.024318 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c8666cbe-77ba-483c-8d3e-f95fc4fe493e tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:59.030327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8666cbe-77ba-483c-8d3e-f95fc4fe493e tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:59.030812 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8666cbe-77ba-483c-8d3e-f95fc4fe493e tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:59.031250 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8666cbe-77ba-483c-8d3e-f95fc4fe493e tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:59.031950 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8666cbe-77ba-483c-8d3e-f95fc4fe493e tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:59.032407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8666cbe-77ba-483c-8d3e-f95fc4fe493e tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:59.032851 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c8666cbe-77ba-483c-8d3e-f95fc4fe493e tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:59.171639 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c8666cbe-77ba-483c-8d3e-f95fc4fe493e tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:26:59.180067 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c8666cbe-77ba-483c-8d3e-f95fc4fe493e tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1470 microversion: 2.1 time: 0.160222 Aug 24 10:26:59.180639 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 500/1009] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:26:59 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:26:59.687346 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-746a2335-c65c-4dd9-ba9e-2814ce2f4a16 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:26:59.687927 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-746a2335-c65c-4dd9-ba9e-2814ce2f4a16 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:26:59.694874 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-746a2335-c65c-4dd9-ba9e-2814ce2f4a16 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:59.695334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-746a2335-c65c-4dd9-ba9e-2814ce2f4a16 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:59.695769 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-746a2335-c65c-4dd9-ba9e-2814ce2f4a16 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:59.696461 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-746a2335-c65c-4dd9-ba9e-2814ce2f4a16 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:26:59.696936 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-746a2335-c65c-4dd9-ba9e-2814ce2f4a16 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:26:59.697364 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-746a2335-c65c-4dd9-ba9e-2814ce2f4a16 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:26:59.780288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-746a2335-c65c-4dd9-ba9e-2814ce2f4a16 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lazy-loading 'services' on Instance uuid 7eaba60b-1efd-43fb-8304-7d9c3889b97a {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:27:00.053897 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-746a2335-c65c-4dd9-ba9e-2814ce2f4a16 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a/os-volume_attachments/5a3131e4-b55e-4fe2-b441-7d3f8e456541" status: 202 len: 0 microversion: 2.1 time: 0.370585 Aug 24 10:27:00.054513 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 510/1010] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:26:59 2022] DELETE /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a/os-volume_attachments/5a3131e4-b55e-4fe2-b441-7d3f8e456541 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:27:00.201840 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c57a0fbf-d39b-4c68-a6b7-8810e18b6cf6 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:00.202447 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c57a0fbf-d39b-4c68-a6b7-8810e18b6cf6 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:00.209950 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c57a0fbf-d39b-4c68-a6b7-8810e18b6cf6 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:00.210566 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c57a0fbf-d39b-4c68-a6b7-8810e18b6cf6 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:00.211241 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c57a0fbf-d39b-4c68-a6b7-8810e18b6cf6 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:00.211945 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c57a0fbf-d39b-4c68-a6b7-8810e18b6cf6 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:00.212400 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c57a0fbf-d39b-4c68-a6b7-8810e18b6cf6 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:00.212825 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c57a0fbf-d39b-4c68-a6b7-8810e18b6cf6 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:00.343855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c57a0fbf-d39b-4c68-a6b7-8810e18b6cf6 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:00.352078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c57a0fbf-d39b-4c68-a6b7-8810e18b6cf6 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1470 microversion: 2.1 time: 0.154245 Aug 24 10:27:00.352641 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 501/1011] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:00 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:01.374140 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-86530af7-529f-40e4-94a8-2844c2119552 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:01.374749 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-86530af7-529f-40e4-94a8-2844c2119552 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:01.381931 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86530af7-529f-40e4-94a8-2844c2119552 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:01.382412 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86530af7-529f-40e4-94a8-2844c2119552 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:01.382840 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86530af7-529f-40e4-94a8-2844c2119552 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:01.383532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86530af7-529f-40e4-94a8-2844c2119552 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:01.383978 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86530af7-529f-40e4-94a8-2844c2119552 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:01.384396 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86530af7-529f-40e4-94a8-2844c2119552 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:01.523001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-86530af7-529f-40e4-94a8-2844c2119552 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:01.531216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-86530af7-529f-40e4-94a8-2844c2119552 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1470 microversion: 2.1 time: 0.161318 Aug 24 10:27:01.532216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 511/1012] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:01 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:01.829839 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-e15ec3f0-c094-4832-9956-41cc067a7cd7 req-1a33abea-fa88-420d-b29f-65442ac6967b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4241f7e1-0137-48d8-91d2-04537e780493", "name": "network-vif-deleted", "tag": "144e137f-93ac-4030-b5ac-a42e8f6460ec"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:01.840714 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e15ec3f0-c094-4832-9956-41cc067a7cd7 req-1a33abea-fa88-420d-b29f-65442ac6967b service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:01.841717 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e15ec3f0-c094-4832-9956-41cc067a7cd7 req-1a33abea-fa88-420d-b29f-65442ac6967b service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:01.842283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-e15ec3f0-c094-4832-9956-41cc067a7cd7 req-1a33abea-fa88-420d-b29f-65442ac6967b service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:01.856277 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-e15ec3f0-c094-4832-9956-41cc067a7cd7 req-1a33abea-fa88-420d-b29f-65442ac6967b service nova] Creating event network-vif-deleted:144e137f-93ac-4030-b5ac-a42e8f6460ec for instance 4241f7e1-0137-48d8-91d2-04537e780493 on hv-cinder-85427 Aug 24 10:27:01.861555 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-e15ec3f0-c094-4832-9956-41cc067a7cd7 req-1a33abea-fa88-420d-b29f-65442ac6967b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035592 Aug 24 10:27:01.862189 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 502/1013] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:27:02.236648 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-29c78ad2-f875-44d9-9e38-a29e383f9173 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:02.237194 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-29c78ad2-f875-44d9-9e38-a29e383f9173 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:02.243792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-29c78ad2-f875-44d9-9e38-a29e383f9173 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.244281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-29c78ad2-f875-44d9-9e38-a29e383f9173 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.244713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-29c78ad2-f875-44d9-9e38-a29e383f9173 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.245492 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-29c78ad2-f875-44d9-9e38-a29e383f9173 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.245941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-29c78ad2-f875-44d9-9e38-a29e383f9173 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.246362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-29c78ad2-f875-44d9-9e38-a29e383f9173 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.270967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-29c78ad2-f875-44d9-9e38-a29e383f9173 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:27:02.553954 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:02.554577 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:02.560797 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.565964 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.565964 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.565964 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.565964 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.566409 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.594269 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.594741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.595196 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.595663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lazy-loading 'fault' on Instance uuid 4241f7e1-0137-48d8-91d2-04537e780493 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:27:02.639386 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:02.648335 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-090d757e-c7f6-4cb9-96a3-da308139cb92 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1305 microversion: 2.1 time: 0.098748 Aug 24 10:27:02.648933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 503/1014] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:02 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:02.723206 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-29c78ad2-f875-44d9-9e38-a29e383f9173 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 204 len: 0 microversion: 2.1 time: 0.489565 Aug 24 10:27:02.723918 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 512/1015] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:27:02 2022] DELETE /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:27:02.732223 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-37d8b5e8-7a46-43a2-8110-6a9c1556863a tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:02.732847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-37d8b5e8-7a46-43a2-8110-6a9c1556863a tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:02.739675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d8b5e8-7a46-43a2-8110-6a9c1556863a tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.746092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d8b5e8-7a46-43a2-8110-6a9c1556863a tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.746092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d8b5e8-7a46-43a2-8110-6a9c1556863a tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.746092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d8b5e8-7a46-43a2-8110-6a9c1556863a tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:02.746092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d8b5e8-7a46-43a2-8110-6a9c1556863a tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:02.746533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-37d8b5e8-7a46-43a2-8110-6a9c1556863a tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:02.874678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-37d8b5e8-7a46-43a2-8110-6a9c1556863a tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:02.883195 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-37d8b5e8-7a46-43a2-8110-6a9c1556863a tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1513 microversion: 2.1 time: 0.154978 Aug 24 10:27:02.883976 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 504/1016] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:02 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:03.669784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:03.670481 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:03.677665 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:03.678148 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:03.678575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:03.679263 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:03.679715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:03.680133 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:03.711791 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:03.712266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:03.712700 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:03.713178 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.objects.instance [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lazy-loading 'fault' on Instance uuid 4241f7e1-0137-48d8-91d2-04537e780493 {{(pid=121271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:27:03.757374 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6257debf16864da8ab702ad8092bd888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab68ba80c53149e8b13154db35c4e2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:03.765286 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f1807bed-a1c6-4e46-9e09-1befb5bafa28 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 200 len: 1305 microversion: 2.1 time: 0.099738 Aug 24 10:27:03.765852 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 513/1017] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:03 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:03.904812 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0d49293a-54eb-40bd-b61e-5a14ce0b028f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:03.905492 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0d49293a-54eb-40bd-b61e-5a14ce0b028f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:03.912115 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d49293a-54eb-40bd-b61e-5a14ce0b028f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:03.912598 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d49293a-54eb-40bd-b61e-5a14ce0b028f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:03.913070 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d49293a-54eb-40bd-b61e-5a14ce0b028f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:03.913795 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d49293a-54eb-40bd-b61e-5a14ce0b028f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:03.914242 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d49293a-54eb-40bd-b61e-5a14ce0b028f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:03.914662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0d49293a-54eb-40bd-b61e-5a14ce0b028f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:04.051905 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0d49293a-54eb-40bd-b61e-5a14ce0b028f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:04.059805 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0d49293a-54eb-40bd-b61e-5a14ce0b028f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1513 microversion: 2.1 time: 0.158937 Aug 24 10:27:04.060382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 505/1018] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:03 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:04.787839 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:04.788478 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] [instance: 4241f7e1-0137-48d8-91d2-04537e780493] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:04.795154 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:04.795639 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:04.796080 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:04.796777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:04.797283 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:04.797712 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:04.812321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] HTTP exception thrown: Instance 4241f7e1-0137-48d8-91d2-04537e780493 could not be found. Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Request method failure captured: Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 HTTP/1.1 Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfzZZr6RIFqOBmi-YDJyzBMnaIcZgzqH_vp8qkM_W5uopOq2pgO1DEcvoczhtJd4jNJTGEGecl26zGpM29pwHqj2m5iK0QU67M2uYhqFU5hWtXG_oS6JWpSw7p5t1x5ZE082Y9uX1VNZ9MyN33nGXJHuEsuv310QtM9NEAPlCSPb4eI Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: ab68ba80c53149e8b13154db35c4e2c2 Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-VolumesNegativeTest-1888628037 Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:27:04.814127 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ab68ba80c53149e8b13154db35c4e2c2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ab68ba80c53149e8b13154db35c4e2c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ab68ba80c53149e8b13154db35c4e2c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ab68ba80c53149e8b13154db35c4e2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-VolumesNegativeTest-1888628037 Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: ab68ba80c53149e8b13154db35c4e2c2 Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-VolumesNegativeTest-1888628037 Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-VolumesNegativeTest-1888628037-project Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 6257debf16864da8ab702ad8092bd888 Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-VolumesNegativeTest-1888628037-project Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 4241f7e1-0137-48d8-91d2-04537e780493 could not be found. Aug 24 10:27:04.815880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '4241f7e1-0137-48d8-91d2-04537e780493'} Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4241f7e1-0137-48d8-91d2-04537e780493 could not be found. Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:04.817666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4241f7e1-0137-48d8-91d2-04537e780493 could not be found. Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4241f7e1-0137-48d8-91d2-04537e780493 could not be found. Aug 24 10:27:04.819334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:27:04.820751 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] Returning 404 to user: Instance 4241f7e1-0137-48d8-91d2-04537e780493 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:04.820751 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-48e4b697-bd20-47a8-8591-87d663bf5952 tempest-VolumesNegativeTest-1888628037 tempest-VolumesNegativeTest-1888628037-project] 10.222.0.30 "GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493" status: 404 len: 111 microversion: 2.1 time: 0.032197 Aug 24 10:27:04.820751 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 514/1019] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:04 2022] GET /compute/v2.1/servers/4241f7e1-0137-48d8-91d2-04537e780493 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:05.080593 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-89b868c2-4ace-4c8c-9b82-c07763f0d4a6 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:05.081159 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-89b868c2-4ace-4c8c-9b82-c07763f0d4a6 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:05.087834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-89b868c2-4ace-4c8c-9b82-c07763f0d4a6 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:05.092166 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-89b868c2-4ace-4c8c-9b82-c07763f0d4a6 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:05.092166 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-89b868c2-4ace-4c8c-9b82-c07763f0d4a6 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:05.092166 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-89b868c2-4ace-4c8c-9b82-c07763f0d4a6 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:05.092166 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-89b868c2-4ace-4c8c-9b82-c07763f0d4a6 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:05.092545 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-89b868c2-4ace-4c8c-9b82-c07763f0d4a6 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:05.234208 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-89b868c2-4ace-4c8c-9b82-c07763f0d4a6 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:05.243261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-89b868c2-4ace-4c8c-9b82-c07763f0d4a6 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1513 microversion: 2.1 time: 0.166606 Aug 24 10:27:05.243843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 506/1020] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:05 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:05.981602 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-e9ad615c-b872-45f9-bec4-df5b67a7f15c req-ac93e474-6d54-4a67-8110-3999fb633f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eaba60b-1efd-43fb-8304-7d9c3889b97a", "name": "network-vif-deleted", "tag": "6b07ab11-673d-4cde-aad0-1c26b2ba02fb"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:06.001116 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-e9ad615c-b872-45f9-bec4-df5b67a7f15c req-ac93e474-6d54-4a67-8110-3999fb633f84 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:06.001116 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-e9ad615c-b872-45f9-bec4-df5b67a7f15c req-ac93e474-6d54-4a67-8110-3999fb633f84 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:06.001116 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-e9ad615c-b872-45f9-bec4-df5b67a7f15c req-ac93e474-6d54-4a67-8110-3999fb633f84 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:06.011996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-e9ad615c-b872-45f9-bec4-df5b67a7f15c req-ac93e474-6d54-4a67-8110-3999fb633f84 service nova] Creating event network-vif-deleted:6b07ab11-673d-4cde-aad0-1c26b2ba02fb for instance 7eaba60b-1efd-43fb-8304-7d9c3889b97a on hv-cinder-85427 Aug 24 10:27:06.019286 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-e9ad615c-b872-45f9-bec4-df5b67a7f15c req-ac93e474-6d54-4a67-8110-3999fb633f84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041989 Aug 24 10:27:06.020468 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 515/1021] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:06.266779 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-81375dda-7ceb-4e71-996b-b070c8113ae1 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:06.267935 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-81375dda-7ceb-4e71-996b-b070c8113ae1 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:06.277919 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-81375dda-7ceb-4e71-996b-b070c8113ae1 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:06.278418 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-81375dda-7ceb-4e71-996b-b070c8113ae1 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:06.278859 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-81375dda-7ceb-4e71-996b-b070c8113ae1 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:06.279672 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-81375dda-7ceb-4e71-996b-b070c8113ae1 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:06.280133 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-81375dda-7ceb-4e71-996b-b070c8113ae1 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:06.280757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-81375dda-7ceb-4e71-996b-b070c8113ae1 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:06.384688 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-81375dda-7ceb-4e71-996b-b070c8113ae1 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:06.401733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-81375dda-7ceb-4e71-996b-b070c8113ae1 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 200 len: 1304 microversion: 2.1 time: 0.140755 Aug 24 10:27:06.402780 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 507/1022] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:06 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:07.424233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:07.424921 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 7eaba60b-1efd-43fb-8304-7d9c3889b97a] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:07.432266 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:07.432744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:07.433204 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:07.433898 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:07.434352 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:07.434772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:07.449458 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] HTTP exception thrown: Instance 7eaba60b-1efd-43fb-8304-7d9c3889b97a could not be found. Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Request method failure captured: Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a HTTP/1.1 Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfytXa497bQ-WQEMvBkezs6fIqb1voRWMrNOfNy9EqiwGW_rzAt5gi7UMW8iuJfs_jZg51RFV0_SRolGyIx_vzIEW5sQafJwlMjfOrzxiXAWtCVxORVgu1_zIv3B9dD3DZlo7xzVvzITyVs2eHgpumxYYIC9D9NCsy2H8c4XVcqGZLk Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 7d5efdccb2b64693a0a950c711114f3a Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1507418581 Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:27:07.451108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7d5efdccb2b64693a0a950c711114f3a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d5efdccb2b64693a0a950c711114f3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7d5efdccb2b64693a0a950c711114f3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d5efdccb2b64693a0a950c711114f3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-VolumesSnapshotTestJSON-1507418581 Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 7d5efdccb2b64693a0a950c711114f3a Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1507418581 Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-VolumesSnapshotTestJSON-1507418581-project Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 82c3bba1fcac455684cc0c8190f8231e Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-VolumesSnapshotTestJSON-1507418581-project Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 7eaba60b-1efd-43fb-8304-7d9c3889b97a could not be found. Aug 24 10:27:07.452832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '7eaba60b-1efd-43fb-8304-7d9c3889b97a'} Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eaba60b-1efd-43fb-8304-7d9c3889b97a could not be found. Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:27:07.453806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eaba60b-1efd-43fb-8304-7d9c3889b97a could not be found. Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eaba60b-1efd-43fb-8304-7d9c3889b97a could not be found. Aug 24 10:27:07.455123 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:27:07.456281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Returning 404 to user: Instance 7eaba60b-1efd-43fb-8304-7d9c3889b97a could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:27:07.456281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bd28cb5c-f90e-4795-91fc-45d7bb883581 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a" status: 404 len: 111 microversion: 2.1 time: 0.033485 Aug 24 10:27:07.456281 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 516/1023] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:07 2022] GET /compute/v2.1/servers/7eaba60b-1efd-43fb-8304-7d9c3889b97a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:27:11.273811 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:27:11.274424 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Wed Aug 24 10:27:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:27:18.312683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-304680560", "imageRef": "9d1b0127-0434-467a-b071-dc8a40d6a2ec", "flavorRef": "452", "networks": [{"uuid": "ed163e95-0377-4eec-9e74-d5cd8366787d"}]}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:18.321726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=23 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:18.322453 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=75 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:18.369146 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] validate_networks() for [('ed163e95-0377-4eec-9e74-d5cd8366787d', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:27:18.743443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:27:18.743860 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:27:18.744327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:27:18.744730 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:27:18.745169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:27:18.753947 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:18.754934 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:18.755361 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:18.756071 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:18.756511 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:18.756973 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:18.774656 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Getting quotas for project 7d5efdccb2b64693a0a950c711114f3a. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:27:18.778609 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Getting quotas for user 82c3bba1fcac455684cc0c8190f8231e and project 7d5efdccb2b64693a0a950c711114f3a. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:27:18.790075 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:27:18.792345 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d1b0127-0434-467a-b071-dc8a40d6a2ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:27:18.993485 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2f8a4968-699b-4864-9a53-2faa226ab573 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684452 Aug 24 10:27:18.994048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 508/1024] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:27:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:27:19.005805 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3cdc2319-e820-4605-8413-47bd999ea64d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:19.006450 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3cdc2319-e820-4605-8413-47bd999ea64d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:19.009115 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:19.010090 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:19.070632 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3cdc2319-e820-4605-8413-47bd999ea64d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:19.077947 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3cdc2319-e820-4605-8413-47bd999ea64d tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1218 microversion: 2.1 time: 0.076990 Aug 24 10:27:19.082494 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 517/1025] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:18 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:20.101334 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-87537e31-5b57-496d-965c-8b1635180237 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:20.101952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-87537e31-5b57-496d-965c-8b1635180237 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:20.108711 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-87537e31-5b57-496d-965c-8b1635180237 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.109228 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-87537e31-5b57-496d-965c-8b1635180237 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.109767 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-87537e31-5b57-496d-965c-8b1635180237 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.110464 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-87537e31-5b57-496d-965c-8b1635180237 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.110913 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-87537e31-5b57-496d-965c-8b1635180237 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.111330 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-87537e31-5b57-496d-965c-8b1635180237 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.183224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-87537e31-5b57-496d-965c-8b1635180237 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:20.192447 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-87537e31-5b57-496d-965c-8b1635180237 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1222 microversion: 2.1 time: 0.096843 Aug 24 10:27:20.193196 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 509/1026] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:20 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:20.272880 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-cb7bf658-471c-470a-a451-7fdf45f20cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:20.275528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-cb7bf658-471c-470a-a451-7fdf45f20cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:20.284069 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb7bf658-471c-470a-a451-7fdf45f20cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.284659 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb7bf658-471c-470a-a451-7fdf45f20cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.285332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb7bf658-471c-470a-a451-7fdf45f20cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.287102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb7bf658-471c-470a-a451-7fdf45f20cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.287786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb7bf658-471c-470a-a451-7fdf45f20cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.288408 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-cb7bf658-471c-470a-a451-7fdf45f20cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.538313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-cb7bf658-471c-470a-a451-7fdf45f20cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "POST /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/action" status: 202 len: 0 microversion: 2.1 time: 0.270207 Aug 24 10:27:20.539048 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 518/1027] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:27:20 2022] POST /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:27:20.552139 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-83dbe150-7c32-45f8-82c4-66a546e63b59 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:20.552776 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-83dbe150-7c32-45f8-82c4-66a546e63b59 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:20.558996 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-83dbe150-7c32-45f8-82c4-66a546e63b59 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.559533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-83dbe150-7c32-45f8-82c4-66a546e63b59 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.559971 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-83dbe150-7c32-45f8-82c4-66a546e63b59 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.560669 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-83dbe150-7c32-45f8-82c4-66a546e63b59 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:20.561202 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-83dbe150-7c32-45f8-82c4-66a546e63b59 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:20.561661 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-83dbe150-7c32-45f8-82c4-66a546e63b59 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:20.715689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-83dbe150-7c32-45f8-82c4-66a546e63b59 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:20.723981 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-83dbe150-7c32-45f8-82c4-66a546e63b59 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1751 microversion: 2.1 time: 0.176348 Aug 24 10:27:20.724553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 510/1028] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:20 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:21.215627 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bbe7cd6c-7ef1-4445-abc8-75e01c85edd5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:21.216431 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bbe7cd6c-7ef1-4445-abc8-75e01c85edd5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:21.223043 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd6c-7ef1-4445-abc8-75e01c85edd5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:21.224150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd6c-7ef1-4445-abc8-75e01c85edd5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:21.224329 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd6c-7ef1-4445-abc8-75e01c85edd5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:21.227700 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd6c-7ef1-4445-abc8-75e01c85edd5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:21.227700 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd6c-7ef1-4445-abc8-75e01c85edd5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:21.227700 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbe7cd6c-7ef1-4445-abc8-75e01c85edd5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:21.309770 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-bbe7cd6c-7ef1-4445-abc8-75e01c85edd5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:21.318706 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bbe7cd6c-7ef1-4445-abc8-75e01c85edd5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1278 microversion: 2.1 time: 0.108897 Aug 24 10:27:21.319379 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 519/1029] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:21 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:21.745680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9d6655ee-f5d3-48ab-b477-f81c3fa68144 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:21.746748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9d6655ee-f5d3-48ab-b477-f81c3fa68144 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:21.755185 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d6655ee-f5d3-48ab-b477-f81c3fa68144 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:21.755949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d6655ee-f5d3-48ab-b477-f81c3fa68144 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:21.756221 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d6655ee-f5d3-48ab-b477-f81c3fa68144 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:21.756990 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d6655ee-f5d3-48ab-b477-f81c3fa68144 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:21.757455 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d6655ee-f5d3-48ab-b477-f81c3fa68144 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:21.757880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9d6655ee-f5d3-48ab-b477-f81c3fa68144 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:22.297373 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9d6655ee-f5d3-48ab-b477-f81c3fa68144 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:22.307368 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9d6655ee-f5d3-48ab-b477-f81c3fa68144 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1751 microversion: 2.1 time: 0.565727 Aug 24 10:27:22.307950 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 511/1030] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:21 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1751 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:22.339619 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d751bc6f-b42c-4900-85f2-106e59d33a94 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:22.340235 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d751bc6f-b42c-4900-85f2-106e59d33a94 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:22.346098 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751bc6f-b42c-4900-85f2-106e59d33a94 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:22.346578 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751bc6f-b42c-4900-85f2-106e59d33a94 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:22.347009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751bc6f-b42c-4900-85f2-106e59d33a94 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:22.347778 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751bc6f-b42c-4900-85f2-106e59d33a94 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:22.349220 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751bc6f-b42c-4900-85f2-106e59d33a94 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:22.349803 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d751bc6f-b42c-4900-85f2-106e59d33a94 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:22.413270 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d751bc6f-b42c-4900-85f2-106e59d33a94 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:22.421100 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d751bc6f-b42c-4900-85f2-106e59d33a94 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1276 microversion: 2.1 time: 0.085364 Aug 24 10:27:22.421690 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 520/1031] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:22 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:23.327749 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d9253ab2-b78d-4409-9037-ef87c9fc2f75 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:23.328348 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d9253ab2-b78d-4409-9037-ef87c9fc2f75 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:23.336004 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d9253ab2-b78d-4409-9037-ef87c9fc2f75 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:23.336480 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d9253ab2-b78d-4409-9037-ef87c9fc2f75 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:23.336943 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d9253ab2-b78d-4409-9037-ef87c9fc2f75 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:23.337798 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d9253ab2-b78d-4409-9037-ef87c9fc2f75 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:23.338239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d9253ab2-b78d-4409-9037-ef87c9fc2f75 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:23.338668 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d9253ab2-b78d-4409-9037-ef87c9fc2f75 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:23.443795 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-21ddbecd-7291-4ec0-b207-c37e7d071ba3 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:23.444421 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-21ddbecd-7291-4ec0-b207-c37e7d071ba3 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:23.451344 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21ddbecd-7291-4ec0-b207-c37e7d071ba3 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:23.451829 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21ddbecd-7291-4ec0-b207-c37e7d071ba3 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:23.452263 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21ddbecd-7291-4ec0-b207-c37e7d071ba3 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:23.454003 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21ddbecd-7291-4ec0-b207-c37e7d071ba3 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:23.454003 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21ddbecd-7291-4ec0-b207-c37e7d071ba3 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:23.454003 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-21ddbecd-7291-4ec0-b207-c37e7d071ba3 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:23.541628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d9253ab2-b78d-4409-9037-ef87c9fc2f75 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:23.556646 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d9253ab2-b78d-4409-9037-ef87c9fc2f75 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1756 microversion: 2.1 time: 0.226883 Aug 24 10:27:23.556646 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 512/1032] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:23 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:23.612009 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-21ddbecd-7291-4ec0-b207-c37e7d071ba3 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:23.624994 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-21ddbecd-7291-4ec0-b207-c37e7d071ba3 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1318 microversion: 2.1 time: 0.185438 Aug 24 10:27:23.625872 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 521/1033] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:23 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:23.680694 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-7f5a1e16-25e1-4f15-b7c9-0b64ef473fdf req-872a4310-254c-4351-a89a-9d225cbfd214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008b635d-b2cc-4981-8fe6-7471469bcea3", "tag": "73e5de80-1de6-4a61-bbef-41015783e8b6"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:23.691143 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-7f5a1e16-25e1-4f15-b7c9-0b64ef473fdf req-872a4310-254c-4351-a89a-9d225cbfd214 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:23.692252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-7f5a1e16-25e1-4f15-b7c9-0b64ef473fdf req-872a4310-254c-4351-a89a-9d225cbfd214 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:23.693077 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-7f5a1e16-25e1-4f15-b7c9-0b64ef473fdf req-872a4310-254c-4351-a89a-9d225cbfd214 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:23.710295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-7f5a1e16-25e1-4f15-b7c9-0b64ef473fdf req-872a4310-254c-4351-a89a-9d225cbfd214 service nova] Creating event network-changed:73e5de80-1de6-4a61-bbef-41015783e8b6 for instance 008b635d-b2cc-4981-8fe6-7471469bcea3 on hv-cinder-85427 Aug 24 10:27:23.716129 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-7f5a1e16-25e1-4f15-b7c9-0b64ef473fdf req-872a4310-254c-4351-a89a-9d225cbfd214 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039888 Aug 24 10:27:23.716986 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 513/1034] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:24.572227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a12c78a4-8f7a-4a60-bec7-bbc8c6622013 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:24.572763 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a12c78a4-8f7a-4a60-bec7-bbc8c6622013 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:24.579715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a12c78a4-8f7a-4a60-bec7-bbc8c6622013 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:24.586379 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a12c78a4-8f7a-4a60-bec7-bbc8c6622013 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:24.586379 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a12c78a4-8f7a-4a60-bec7-bbc8c6622013 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:24.586379 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a12c78a4-8f7a-4a60-bec7-bbc8c6622013 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:24.586379 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a12c78a4-8f7a-4a60-bec7-bbc8c6622013 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:24.586820 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a12c78a4-8f7a-4a60-bec7-bbc8c6622013 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:24.648603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-6e349655-4d66-4c1b-908a-12f17e3e0dc8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:24.649385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-6e349655-4d66-4c1b-908a-12f17e3e0dc8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:24.655820 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e349655-4d66-4c1b-908a-12f17e3e0dc8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:24.656345 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e349655-4d66-4c1b-908a-12f17e3e0dc8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:24.656803 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e349655-4d66-4c1b-908a-12f17e3e0dc8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:24.657562 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e349655-4d66-4c1b-908a-12f17e3e0dc8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:24.658021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e349655-4d66-4c1b-908a-12f17e3e0dc8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:24.658495 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-6e349655-4d66-4c1b-908a-12f17e3e0dc8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:24.728446 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a12c78a4-8f7a-4a60-bec7-bbc8c6622013 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:24.738005 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a12c78a4-8f7a-4a60-bec7-bbc8c6622013 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1756 microversion: 2.1 time: 0.169909 Aug 24 10:27:24.738628 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 522/1035] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:24 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:24.795662 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-6e349655-4d66-4c1b-908a-12f17e3e0dc8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:24.804094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-6e349655-4d66-4c1b-908a-12f17e3e0dc8 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1318 microversion: 2.1 time: 0.160805 Aug 24 10:27:24.804666 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 514/1036] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:24 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:25.760174 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f10c8fbe-3576-43ae-b9d9-5cfdd46f9d45 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:25.760803 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f10c8fbe-3576-43ae-b9d9-5cfdd46f9d45 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:25.767867 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10c8fbe-3576-43ae-b9d9-5cfdd46f9d45 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.768395 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10c8fbe-3576-43ae-b9d9-5cfdd46f9d45 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.769045 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10c8fbe-3576-43ae-b9d9-5cfdd46f9d45 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.770778 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10c8fbe-3576-43ae-b9d9-5cfdd46f9d45 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.771206 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10c8fbe-3576-43ae-b9d9-5cfdd46f9d45 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.771664 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f10c8fbe-3576-43ae-b9d9-5cfdd46f9d45 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.825158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-76f475fe-f09d-4195-bda7-28e8ea64a56c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:25.825774 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-76f475fe-f09d-4195-bda7-28e8ea64a56c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:25.832704 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76f475fe-f09d-4195-bda7-28e8ea64a56c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.833308 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76f475fe-f09d-4195-bda7-28e8ea64a56c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.833742 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76f475fe-f09d-4195-bda7-28e8ea64a56c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.834432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76f475fe-f09d-4195-bda7-28e8ea64a56c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:25.834880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76f475fe-f09d-4195-bda7-28e8ea64a56c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:25.835295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-76f475fe-f09d-4195-bda7-28e8ea64a56c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:25.920029 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f10c8fbe-3576-43ae-b9d9-5cfdd46f9d45 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:25.928797 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f10c8fbe-3576-43ae-b9d9-5cfdd46f9d45 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1756 microversion: 2.1 time: 0.172578 Aug 24 10:27:25.934051 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 523/1037] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:25 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:25.980270 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-76f475fe-f09d-4195-bda7-28e8ea64a56c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:25.988163 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-76f475fe-f09d-4195-bda7-28e8ea64a56c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1318 microversion: 2.1 time: 0.166861 Aug 24 10:27:25.988795 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 515/1038] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:25 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:26.950991 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7bde56ed-738a-467f-810f-fe506cb7b4c4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:26.951687 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7bde56ed-738a-467f-810f-fe506cb7b4c4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:26.958301 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bde56ed-738a-467f-810f-fe506cb7b4c4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:26.958788 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bde56ed-738a-467f-810f-fe506cb7b4c4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:26.959219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bde56ed-738a-467f-810f-fe506cb7b4c4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:26.959909 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bde56ed-738a-467f-810f-fe506cb7b4c4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:26.960358 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bde56ed-738a-467f-810f-fe506cb7b4c4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:26.960776 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7bde56ed-738a-467f-810f-fe506cb7b4c4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:27.008831 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9c38f9b8-7067-4c7f-84b7-604d4c1dd846 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:27.009704 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9c38f9b8-7067-4c7f-84b7-604d4c1dd846 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:27.016319 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c38f9b8-7067-4c7f-84b7-604d4c1dd846 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:27.016907 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c38f9b8-7067-4c7f-84b7-604d4c1dd846 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:27.017444 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c38f9b8-7067-4c7f-84b7-604d4c1dd846 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:27.018219 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c38f9b8-7067-4c7f-84b7-604d4c1dd846 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:27.018681 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c38f9b8-7067-4c7f-84b7-604d4c1dd846 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:27.019107 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9c38f9b8-7067-4c7f-84b7-604d4c1dd846 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:27.121015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-7bde56ed-738a-467f-810f-fe506cb7b4c4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:27.133915 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7bde56ed-738a-467f-810f-fe506cb7b4c4 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1756 microversion: 2.1 time: 0.186937 Aug 24 10:27:27.134505 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 524/1039] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:26 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:27.165346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9c38f9b8-7067-4c7f-84b7-604d4c1dd846 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:27.173689 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9c38f9b8-7067-4c7f-84b7-604d4c1dd846 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1318 microversion: 2.1 time: 0.168283 Aug 24 10:27:27.173922 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 516/1040] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:27 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:28.157434 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a511c7da-4232-4736-957d-6c1d8c62141b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:28.158083 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a511c7da-4232-4736-957d-6c1d8c62141b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:28.165229 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a511c7da-4232-4736-957d-6c1d8c62141b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.165712 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a511c7da-4232-4736-957d-6c1d8c62141b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.166145 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a511c7da-4232-4736-957d-6c1d8c62141b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:28.166837 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a511c7da-4232-4736-957d-6c1d8c62141b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.167288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a511c7da-4232-4736-957d-6c1d8c62141b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.167715 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a511c7da-4232-4736-957d-6c1d8c62141b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:28.193630 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-808098ef-0061-4163-9815-24df796d609b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:28.194872 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-808098ef-0061-4163-9815-24df796d609b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:28.200996 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-808098ef-0061-4163-9815-24df796d609b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.201842 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-808098ef-0061-4163-9815-24df796d609b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.201975 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-808098ef-0061-4163-9815-24df796d609b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:28.202588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-808098ef-0061-4163-9815-24df796d609b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.203041 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-808098ef-0061-4163-9815-24df796d609b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.203463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-808098ef-0061-4163-9815-24df796d609b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:28.318707 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a511c7da-4232-4736-957d-6c1d8c62141b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:28.326931 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a511c7da-4232-4736-957d-6c1d8c62141b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1756 microversion: 2.1 time: 0.173603 Aug 24 10:27:28.327501 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 525/1041] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:28 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:28.344059 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-808098ef-0061-4163-9815-24df796d609b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:28.352434 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-808098ef-0061-4163-9815-24df796d609b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1318 microversion: 2.1 time: 0.162763 Aug 24 10:27:28.353013 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 517/1042] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:28 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:28.719933 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-672d48bc-ab09-4417-b0ac-0c9e28675c88 req-8f1b9bd5-0014-42b9-b104-9e9df76f1ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008b635d-b2cc-4981-8fe6-7471469bcea3", "name": "network-vif-plugged", "status": "completed", "tag": "73e5de80-1de6-4a61-bbef-41015783e8b6"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:28.730650 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-672d48bc-ab09-4417-b0ac-0c9e28675c88 req-8f1b9bd5-0014-42b9-b104-9e9df76f1ff2 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:28.733980 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-672d48bc-ab09-4417-b0ac-0c9e28675c88 req-8f1b9bd5-0014-42b9-b104-9e9df76f1ff2 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:28.733980 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-672d48bc-ab09-4417-b0ac-0c9e28675c88 req-8f1b9bd5-0014-42b9-b104-9e9df76f1ff2 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:28.744962 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-672d48bc-ab09-4417-b0ac-0c9e28675c88 req-8f1b9bd5-0014-42b9-b104-9e9df76f1ff2 service nova] Creating event network-vif-plugged:73e5de80-1de6-4a61-bbef-41015783e8b6 for instance 008b635d-b2cc-4981-8fe6-7471469bcea3 on hv-cinder-85427 Aug 24 10:27:28.750026 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-672d48bc-ab09-4417-b0ac-0c9e28675c88 req-8f1b9bd5-0014-42b9-b104-9e9df76f1ff2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033774 Aug 24 10:27:28.750671 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 526/1043] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:29.350187 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1e6996de-ba2b-4e6b-995e-95790010e27a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:29.350791 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1e6996de-ba2b-4e6b-995e-95790010e27a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:29.352723 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:29.353461 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=6 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:29.358889 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e6996de-ba2b-4e6b-995e-95790010e27a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:29.359360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e6996de-ba2b-4e6b-995e-95790010e27a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:29.359790 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e6996de-ba2b-4e6b-995e-95790010e27a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:29.360466 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e6996de-ba2b-4e6b-995e-95790010e27a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:29.360938 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e6996de-ba2b-4e6b-995e-95790010e27a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:29.361353 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e6996de-ba2b-4e6b-995e-95790010e27a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:29.371488 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:29.376166 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-90315e4d-f715-45a9-92af-134a53f4c814 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:29.376917 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-90315e4d-f715-45a9-92af-134a53f4c814 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:29.383270 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-90315e4d-f715-45a9-92af-134a53f4c814 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:29.383754 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-90315e4d-f715-45a9-92af-134a53f4c814 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:29.384187 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-90315e4d-f715-45a9-92af-134a53f4c814 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:29.384910 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-90315e4d-f715-45a9-92af-134a53f4c814 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:29.385367 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-90315e4d-f715-45a9-92af-134a53f4c814 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:29.385788 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-90315e4d-f715-45a9-92af-134a53f4c814 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:29.517322 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1e6996de-ba2b-4e6b-995e-95790010e27a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:29.525695 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-90315e4d-f715-45a9-92af-134a53f4c814 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:29.526855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1e6996de-ba2b-4e6b-995e-95790010e27a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1756 microversion: 2.1 time: 0.181158 Aug 24 10:27:29.527440 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 518/1044] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:29 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:29.533548 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-90315e4d-f715-45a9-92af-134a53f4c814 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1318 microversion: 2.1 time: 0.163195 Aug 24 10:27:29.534108 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 527/1045] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:29 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:30.548982 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9011d09e-a236-4f1a-870f-a16f2dad0aba tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:30.549514 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9011d09e-a236-4f1a-870f-a16f2dad0aba tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:30.555389 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-62b1c418-dedc-414b-8d4f-97823f180e1e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:30.556004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-62b1c418-dedc-414b-8d4f-97823f180e1e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:30.556754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9011d09e-a236-4f1a-870f-a16f2dad0aba tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:30.557278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9011d09e-a236-4f1a-870f-a16f2dad0aba tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:30.557716 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9011d09e-a236-4f1a-870f-a16f2dad0aba tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:30.558423 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9011d09e-a236-4f1a-870f-a16f2dad0aba tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:30.558878 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9011d09e-a236-4f1a-870f-a16f2dad0aba tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:30.559302 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9011d09e-a236-4f1a-870f-a16f2dad0aba tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:30.562444 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-62b1c418-dedc-414b-8d4f-97823f180e1e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:30.564301 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-62b1c418-dedc-414b-8d4f-97823f180e1e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:30.564301 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-62b1c418-dedc-414b-8d4f-97823f180e1e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:30.564301 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-62b1c418-dedc-414b-8d4f-97823f180e1e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:30.564625 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-62b1c418-dedc-414b-8d4f-97823f180e1e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:30.564886 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-62b1c418-dedc-414b-8d4f-97823f180e1e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:30.694222 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-62b1c418-dedc-414b-8d4f-97823f180e1e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:30.701774 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-62b1c418-dedc-414b-8d4f-97823f180e1e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1318 microversion: 2.1 time: 0.151207 Aug 24 10:27:30.702344 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 528/1046] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:30 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:30.708090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9011d09e-a236-4f1a-870f-a16f2dad0aba tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:30.716358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9011d09e-a236-4f1a-870f-a16f2dad0aba tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1756 microversion: 2.1 time: 0.171374 Aug 24 10:27:30.716941 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 519/1047] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:30 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:31.721647 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f98ddfab-bb46-4f68-93c2-0926c192ad53 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:31.722352 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f98ddfab-bb46-4f68-93c2-0926c192ad53 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:31.730032 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f98ddfab-bb46-4f68-93c2-0926c192ad53 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.730552 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f98ddfab-bb46-4f68-93c2-0926c192ad53 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.731016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f98ddfab-bb46-4f68-93c2-0926c192ad53 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.731755 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f98ddfab-bb46-4f68-93c2-0926c192ad53 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.732326 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f98ddfab-bb46-4f68-93c2-0926c192ad53 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.732761 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f98ddfab-bb46-4f68-93c2-0926c192ad53 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.739372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0f8603d7-a843-4ca7-bcf3-c7acc460ec8c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:31.740151 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0f8603d7-a843-4ca7-bcf3-c7acc460ec8c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:31.749186 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f8603d7-a843-4ca7-bcf3-c7acc460ec8c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.749590 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f8603d7-a843-4ca7-bcf3-c7acc460ec8c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.750049 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f8603d7-a843-4ca7-bcf3-c7acc460ec8c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.750745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f8603d7-a843-4ca7-bcf3-c7acc460ec8c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.751317 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f8603d7-a843-4ca7-bcf3-c7acc460ec8c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.751741 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0f8603d7-a843-4ca7-bcf3-c7acc460ec8c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.873866 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f98ddfab-bb46-4f68-93c2-0926c192ad53 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:31.882625 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f98ddfab-bb46-4f68-93c2-0926c192ad53 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1506 microversion: 2.1 time: 0.164834 Aug 24 10:27:31.883220 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 529/1048] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:31 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:31.903538 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-c92928fa-a977-4112-8971-9ca9c439847c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f6bb98f-4033-4e79-b5c8-d3bb3f797014", "device": "/dev/sdb"}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:27:31.906294 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0f8603d7-a843-4ca7-bcf3-c7acc460ec8c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:31.906523 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-c92928fa-a977-4112-8971-9ca9c439847c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:31.916409 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c92928fa-a977-4112-8971-9ca9c439847c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.916409 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c92928fa-a977-4112-8971-9ca9c439847c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.916409 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c92928fa-a977-4112-8971-9ca9c439847c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:31.917112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0f8603d7-a843-4ca7-bcf3-c7acc460ec8c tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1756 microversion: 2.1 time: 0.180799 Aug 24 10:27:31.917227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c92928fa-a977-4112-8971-9ca9c439847c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:31.917227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c92928fa-a977-4112-8971-9ca9c439847c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:31.917380 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 520/1049] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:31 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:27:31.917470 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-c92928fa-a977-4112-8971-9ca9c439847c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:32.909125 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-c92928fa-a977-4112-8971-9ca9c439847c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "POST /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.009578 Aug 24 10:27:32.909881 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 530/1050] 10.222.0.30 () {60 vars in 1323 bytes} [Wed Aug 24 10:27:31 2022] POST /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3/os-volume_attachments => generated 194 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:27:32.940224 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-871a54f2-d50f-41e0-83d1-1c5a4e4194cb tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:32.941256 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-871a54f2-d50f-41e0-83d1-1c5a4e4194cb tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:32.948256 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-871a54f2-d50f-41e0-83d1-1c5a4e4194cb tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:32.948735 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-871a54f2-d50f-41e0-83d1-1c5a4e4194cb tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:32.949194 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-871a54f2-d50f-41e0-83d1-1c5a4e4194cb tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:32.949886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-871a54f2-d50f-41e0-83d1-1c5a4e4194cb tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:32.950346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-871a54f2-d50f-41e0-83d1-1c5a4e4194cb tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:32.950932 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-871a54f2-d50f-41e0-83d1-1c5a4e4194cb tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:33.120513 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-871a54f2-d50f-41e0-83d1-1c5a4e4194cb tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:33.129326 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-871a54f2-d50f-41e0-83d1-1c5a4e4194cb tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1756 microversion: 2.1 time: 0.193883 Aug 24 10:27:33.135074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 521/1051] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:32 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:34.152620 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-44af8883-8ea4-4ac2-9236-560aa1194cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:34.153264 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-44af8883-8ea4-4ac2-9236-560aa1194cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:34.160959 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44af8883-8ea4-4ac2-9236-560aa1194cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:34.161620 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44af8883-8ea4-4ac2-9236-560aa1194cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:34.162252 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44af8883-8ea4-4ac2-9236-560aa1194cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:34.163181 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44af8883-8ea4-4ac2-9236-560aa1194cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:34.163642 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44af8883-8ea4-4ac2-9236-560aa1194cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:34.164077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44af8883-8ea4-4ac2-9236-560aa1194cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:34.324428 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-44af8883-8ea4-4ac2-9236-560aa1194cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:34.333463 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-44af8883-8ea4-4ac2-9236-560aa1194cd5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1759 microversion: 2.1 time: 0.185558 Aug 24 10:27:34.340996 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 531/1052] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:34 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:54.163068 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bcf6e6d7-3b0f-4c10-944f-69bdd518ac4c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:54.163630 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bcf6e6d7-3b0f-4c10-944f-69bdd518ac4c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:54.165679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:54.166460 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=76 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:54.171065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcf6e6d7-3b0f-4c10-944f-69bdd518ac4c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.171548 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcf6e6d7-3b0f-4c10-944f-69bdd518ac4c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.171986 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcf6e6d7-3b0f-4c10-944f-69bdd518ac4c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.172678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcf6e6d7-3b0f-4c10-944f-69bdd518ac4c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:54.173167 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcf6e6d7-3b0f-4c10-944f-69bdd518ac4c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:54.177485 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bcf6e6d7-3b0f-4c10-944f-69bdd518ac4c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:54.256154 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-bcf6e6d7-3b0f-4c10-944f-69bdd518ac4c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lazy-loading 'services' on Instance uuid 008b635d-b2cc-4981-8fe6-7471469bcea3 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:27:54.509646 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bcf6e6d7-3b0f-4c10-944f-69bdd518ac4c tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "DELETE /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3/os-volume_attachments/5f6bb98f-4033-4e79-b5c8-d3bb3f797014" status: 202 len: 0 microversion: 2.1 time: 0.351376 Aug 24 10:27:54.510281 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 522/1053] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:27:54 2022] DELETE /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3/os-volume_attachments/5f6bb98f-4033-4e79-b5c8-d3bb3f797014 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:27:56.686497 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-77be8c63-99c9-4383-b984-c68ce296d69e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:56.687061 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-77be8c63-99c9-4383-b984-c68ce296d69e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:56.689762 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=32 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:56.690444 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:27:56.696291 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-77be8c63-99c9-4383-b984-c68ce296d69e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:56.696778 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-77be8c63-99c9-4383-b984-c68ce296d69e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:56.697242 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-77be8c63-99c9-4383-b984-c68ce296d69e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:56.697967 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-77be8c63-99c9-4383-b984-c68ce296d69e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:56.698424 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-77be8c63-99c9-4383-b984-c68ce296d69e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:56.698854 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-77be8c63-99c9-4383-b984-c68ce296d69e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:56.723841 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-77be8c63-99c9-4383-b984-c68ce296d69e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:27:57.075842 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-77be8c63-99c9-4383-b984-c68ce296d69e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "DELETE /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 204 len: 0 microversion: 2.1 time: 0.392789 Aug 24 10:27:57.076385 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 532/1054] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:27:56 2022] DELETE /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 10:27:57.087363 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-53a8af87-3b41-4858-b349-0d4c8abafa1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:57.089997 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-53a8af87-3b41-4858-b349-0d4c8abafa1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:57.094568 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-53a8af87-3b41-4858-b349-0d4c8abafa1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:57.095045 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-53a8af87-3b41-4858-b349-0d4c8abafa1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:57.095474 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-53a8af87-3b41-4858-b349-0d4c8abafa1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:57.096231 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-53a8af87-3b41-4858-b349-0d4c8abafa1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:57.096802 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-53a8af87-3b41-4858-b349-0d4c8abafa1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:57.097246 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-53a8af87-3b41-4858-b349-0d4c8abafa1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:57.236958 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-53a8af87-3b41-4858-b349-0d4c8abafa1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:57.245003 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-53a8af87-3b41-4858-b349-0d4c8abafa1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1512 microversion: 2.1 time: 0.163879 Aug 24 10:27:57.245567 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 523/1055] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:57 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:58.266107 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-86e84a4d-c2e4-4519-a3ac-e0891d366b2b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:58.266919 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-86e84a4d-c2e4-4519-a3ac-e0891d366b2b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:58.273798 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86e84a4d-c2e4-4519-a3ac-e0891d366b2b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.274288 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86e84a4d-c2e4-4519-a3ac-e0891d366b2b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.274722 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86e84a4d-c2e4-4519-a3ac-e0891d366b2b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.275424 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86e84a4d-c2e4-4519-a3ac-e0891d366b2b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:58.275911 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86e84a4d-c2e4-4519-a3ac-e0891d366b2b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:58.276340 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-86e84a4d-c2e4-4519-a3ac-e0891d366b2b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:58.406757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-86e84a4d-c2e4-4519-a3ac-e0891d366b2b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:58.415138 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-86e84a4d-c2e4-4519-a3ac-e0891d366b2b tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1512 microversion: 2.1 time: 0.153350 Aug 24 10:27:58.415711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 533/1056] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:58 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:59.435766 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-f609a3a6-2164-40d2-903b-8334676ec1e5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:27:59.436312 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-f609a3a6-2164-40d2-903b-8334676ec1e5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:27:59.444409 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f609a3a6-2164-40d2-903b-8334676ec1e5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:59.444915 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f609a3a6-2164-40d2-903b-8334676ec1e5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:59.445349 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f609a3a6-2164-40d2-903b-8334676ec1e5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:59.446050 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f609a3a6-2164-40d2-903b-8334676ec1e5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:27:59.446511 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f609a3a6-2164-40d2-903b-8334676ec1e5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:27:59.446931 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-f609a3a6-2164-40d2-903b-8334676ec1e5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:27:59.654496 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-f609a3a6-2164-40d2-903b-8334676ec1e5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:27:59.663288 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-f609a3a6-2164-40d2-903b-8334676ec1e5 tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1512 microversion: 2.1 time: 0.231451 Aug 24 10:27:59.669444 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 524/1057] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:27:59 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:27:59.992768 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-52ffe5b2-9154-4acb-a879-bdf4f82c4edd req-e0df9d22-1e1d-43a7-93f1-0c8dc407eae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008b635d-b2cc-4981-8fe6-7471469bcea3", "name": "network-vif-deleted", "tag": "73e5de80-1de6-4a61-bbef-41015783e8b6"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:00.002443 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-52ffe5b2-9154-4acb-a879-bdf4f82c4edd req-e0df9d22-1e1d-43a7-93f1-0c8dc407eae8 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:00.003033 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-52ffe5b2-9154-4acb-a879-bdf4f82c4edd req-e0df9d22-1e1d-43a7-93f1-0c8dc407eae8 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:00.003470 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-52ffe5b2-9154-4acb-a879-bdf4f82c4edd req-e0df9d22-1e1d-43a7-93f1-0c8dc407eae8 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:00.014913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-52ffe5b2-9154-4acb-a879-bdf4f82c4edd req-e0df9d22-1e1d-43a7-93f1-0c8dc407eae8 service nova] Creating event network-vif-deleted:73e5de80-1de6-4a61-bbef-41015783e8b6 for instance 008b635d-b2cc-4981-8fe6-7471469bcea3 on hv-cinder-85427 Aug 24 10:28:00.024517 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-52ffe5b2-9154-4acb-a879-bdf4f82c4edd req-e0df9d22-1e1d-43a7-93f1-0c8dc407eae8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152147 Aug 24 10:28:00.024517 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 534/1058] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:00.684676 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:00.685315 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:00.692190 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:00.692711 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:00.693210 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:00.693898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:00.694640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:00.694755 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:00.725986 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:00.726443 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:00.726869 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:00.727305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lazy-loading 'fault' on Instance uuid 008b635d-b2cc-4981-8fe6-7471469bcea3 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:28:00.769030 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c3bba1fcac455684cc0c8190f8231e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5efdccb2b64693a0a950c711114f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:00.776618 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9a09fcca-885a-4294-ad37-141e90288e1f tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 200 len: 1308 microversion: 2.1 time: 0.095802 Aug 24 10:28:00.777208 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 525/1059] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:00 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:01.798816 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:01.799505 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] [instance: 008b635d-b2cc-4981-8fe6-7471469bcea3] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:01.805917 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:01.806392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:01.806817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:01.807496 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:01.807943 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:01.808364 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:01.821382 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] HTTP exception thrown: Instance 008b635d-b2cc-4981-8fe6-7471469bcea3 could not be found. Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Request method failure captured: Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 HTTP/1.1 Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfytXa497bQ-WQEMvBkezs6fIqb1voRWMrNOfNy9EqiwGW_rzAt5gi7UMW8iuJfs_jZg51RFV0_SRolGyIx_vzIEW5sQafJwlMjfOrzxiXAWtCVxORVgu1_zIv3B9dD3DZlo7xzVvzITyVs2eHgpumxYYIC9D9NCsy2H8c4XVcqGZLk Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 7d5efdccb2b64693a0a950c711114f3a Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1507418581 Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:28:01.822958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7d5efdccb2b64693a0a950c711114f3a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d5efdccb2b64693a0a950c711114f3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7d5efdccb2b64693a0a950c711114f3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7d5efdccb2b64693a0a950c711114f3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-VolumesSnapshotTestJSON-1507418581 Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 7d5efdccb2b64693a0a950c711114f3a Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1507418581 Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-VolumesSnapshotTestJSON-1507418581-project Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 82c3bba1fcac455684cc0c8190f8231e Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-VolumesSnapshotTestJSON-1507418581-project Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 008b635d-b2cc-4981-8fe6-7471469bcea3 could not be found. Aug 24 10:28:01.824713 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '008b635d-b2cc-4981-8fe6-7471469bcea3'} Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008b635d-b2cc-4981-8fe6-7471469bcea3 could not be found. Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:28:01.825748 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008b635d-b2cc-4981-8fe6-7471469bcea3 could not be found. Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008b635d-b2cc-4981-8fe6-7471469bcea3 could not be found. Aug 24 10:28:01.827422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:28:01.828916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] Returning 404 to user: Instance 008b635d-b2cc-4981-8fe6-7471469bcea3 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:28:01.828916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2e4aaa0d-779d-468d-83e0-ba55d8e0e71e tempest-VolumesSnapshotTestJSON-1507418581 tempest-VolumesSnapshotTestJSON-1507418581-project] 10.222.0.30 "GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3" status: 404 len: 111 microversion: 2.1 time: 0.030131 Aug 24 10:28:01.828916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 535/1060] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:01 2022] GET /compute/v2.1/servers/008b635d-b2cc-4981-8fe6-7471469bcea3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:28:13.570340 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-5b669070-39f0-43ff-997b-31da7ea47340 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-328704070"}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:13.570902 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-5b669070-39f0-43ff-997b-31da7ea47340 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:13.573473 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=10 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:13.574135 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:13.578769 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b669070-39f0-43ff-997b-31da7ea47340 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:13.579256 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b669070-39f0-43ff-997b-31da7ea47340 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:13.579690 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b669070-39f0-43ff-997b-31da7ea47340 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:13.580388 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b669070-39f0-43ff-997b-31da7ea47340 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:13.580936 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b669070-39f0-43ff-997b-31da7ea47340 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:13.581350 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-5b669070-39f0-43ff-997b-31da7ea47340 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:13.721278 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.network.security_group_api [None req-5b669070-39f0-43ff-997b-31da7ea47340 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Removing security group f907c2e9-4fe9-4368-8053-045187d4d884 from port 9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad Aug 24 10:28:14.099603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-5b669070-39f0-43ff-997b-31da7ea47340 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "POST /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/action" status: 202 len: 0 microversion: 2.1 time: 0.524899 Aug 24 10:28:14.099603 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 526/1061] 10.222.0.30 () {60 vars in 1278 bytes} [Wed Aug 24 10:28:13 2022] POST /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:28:14.100384 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:14.100384 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:14.103368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-4d0c59ab-044e-47b9-ae9b-08c0f9fcab8a req-93df4a4a-7bbb-44f3-8c8b-a64ec8927ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fbc3df-348f-4e15-bb60-adef1d1ad97c", "tag": "9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:14.114131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-4d0c59ab-044e-47b9-ae9b-08c0f9fcab8a req-93df4a4a-7bbb-44f3-8c8b-a64ec8927ad8 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:14.114610 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-4d0c59ab-044e-47b9-ae9b-08c0f9fcab8a req-93df4a4a-7bbb-44f3-8c8b-a64ec8927ad8 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:14.115173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-4d0c59ab-044e-47b9-ae9b-08c0f9fcab8a req-93df4a4a-7bbb-44f3-8c8b-a64ec8927ad8 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:14.126739 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-4d0c59ab-044e-47b9-ae9b-08c0f9fcab8a req-93df4a4a-7bbb-44f3-8c8b-a64ec8927ad8 service nova] Creating event network-changed:9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad for instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c on hv-cinder-85427 Aug 24 10:28:14.132213 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-4d0c59ab-044e-47b9-ae9b-08c0f9fcab8a req-93df4a4a-7bbb-44f3-8c8b-a64ec8927ad8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036042 Aug 24 10:28:14.133004 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 536/1062] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:28:15.239254 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-63493ab0-92c4-40d9-9c46-be7f8fed5874 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:15.239794 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-63493ab0-92c4-40d9-9c46-be7f8fed5874 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:15.245728 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63493ab0-92c4-40d9-9c46-be7f8fed5874 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:15.246202 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63493ab0-92c4-40d9-9c46-be7f8fed5874 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:15.246707 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63493ab0-92c4-40d9-9c46-be7f8fed5874 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:15.247394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63493ab0-92c4-40d9-9c46-be7f8fed5874 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:15.247835 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63493ab0-92c4-40d9-9c46-be7f8fed5874 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:15.248248 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-63493ab0-92c4-40d9-9c46-be7f8fed5874 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:15.338541 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-63493ab0-92c4-40d9-9c46-be7f8fed5874 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lazy-loading 'services' on Instance uuid 01fbc3df-348f-4e15-bb60-adef1d1ad97c {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:28:15.625554 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-63493ab0-92c4-40d9-9c46-be7f8fed5874 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "DELETE /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments/cb1846f8-b656-4bae-8e72-609fe9275f8d" status: 202 len: 0 microversion: 2.1 time: 0.391371 Aug 24 10:28:15.626155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 527/1063] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:28:15 2022] DELETE /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments/cb1846f8-b656-4bae-8e72-609fe9275f8d => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:28:15.635466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0c073b6d-5057-4fd1-913d-c223adee0f28 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:15.637879 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0c073b6d-5057-4fd1-913d-c223adee0f28 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:15.646569 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c073b6d-5057-4fd1-913d-c223adee0f28 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:15.647055 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c073b6d-5057-4fd1-913d-c223adee0f28 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:15.647484 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c073b6d-5057-4fd1-913d-c223adee0f28 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:15.648209 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c073b6d-5057-4fd1-913d-c223adee0f28 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:15.648646 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c073b6d-5057-4fd1-913d-c223adee0f28 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:15.649093 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0c073b6d-5057-4fd1-913d-c223adee0f28 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:15.680571 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0c073b6d-5057-4fd1-913d-c223adee0f28 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049463 Aug 24 10:28:15.685335 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 537/1064] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:28:15 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:16.149211 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-c02942e3-e73a-4083-8086-ef5a5d79d109 req-7c5e3d3f-cbc2-4f97-bb33-30a23fd39db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fbc3df-348f-4e15-bb60-adef1d1ad97c", "tag": "9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:16.159065 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c02942e3-e73a-4083-8086-ef5a5d79d109 req-7c5e3d3f-cbc2-4f97-bb33-30a23fd39db9 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:16.160581 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c02942e3-e73a-4083-8086-ef5a5d79d109 req-7c5e3d3f-cbc2-4f97-bb33-30a23fd39db9 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:16.161283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-c02942e3-e73a-4083-8086-ef5a5d79d109 req-7c5e3d3f-cbc2-4f97-bb33-30a23fd39db9 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:16.172972 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-c02942e3-e73a-4083-8086-ef5a5d79d109 req-7c5e3d3f-cbc2-4f97-bb33-30a23fd39db9 service nova] Creating event network-changed:9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad for instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c on hv-cinder-85427 Aug 24 10:28:16.178078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-c02942e3-e73a-4083-8086-ef5a5d79d109 req-7c5e3d3f-cbc2-4f97-bb33-30a23fd39db9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033852 Aug 24 10:28:16.178663 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 528/1065] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:16.694445 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-66c2fa75-c7b8-43ec-b903-a495a5aecded tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:16.697394 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-66c2fa75-c7b8-43ec-b903-a495a5aecded tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:16.704838 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-66c2fa75-c7b8-43ec-b903-a495a5aecded tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:16.705347 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-66c2fa75-c7b8-43ec-b903-a495a5aecded tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:16.705783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-66c2fa75-c7b8-43ec-b903-a495a5aecded tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:16.706487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-66c2fa75-c7b8-43ec-b903-a495a5aecded tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:16.707083 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-66c2fa75-c7b8-43ec-b903-a495a5aecded tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:16.707508 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-66c2fa75-c7b8-43ec-b903-a495a5aecded tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:16.737541 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-66c2fa75-c7b8-43ec-b903-a495a5aecded tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048171 Aug 24 10:28:16.739374 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 538/1066] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:28:16 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:17.754581 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-07778436-7360-4e87-ac5d-13cd544ca586 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:17.756769 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-07778436-7360-4e87-ac5d-13cd544ca586 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:17.765566 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07778436-7360-4e87-ac5d-13cd544ca586 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:17.766500 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07778436-7360-4e87-ac5d-13cd544ca586 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:17.767475 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07778436-7360-4e87-ac5d-13cd544ca586 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:17.768733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07778436-7360-4e87-ac5d-13cd544ca586 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:17.770554 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07778436-7360-4e87-ac5d-13cd544ca586 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:17.771558 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-07778436-7360-4e87-ac5d-13cd544ca586 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:17.805525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-07778436-7360-4e87-ac5d-13cd544ca586 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056852 Aug 24 10:28:17.806114 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 529/1067] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:28:17 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:28:18.818492 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-7d5a03eb-849e-40fe-aebd-420f2ea9b54b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:18.820645 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-7d5a03eb-849e-40fe-aebd-420f2ea9b54b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:18.827178 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7d5a03eb-849e-40fe-aebd-420f2ea9b54b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:18.827663 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7d5a03eb-849e-40fe-aebd-420f2ea9b54b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:18.828124 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7d5a03eb-849e-40fe-aebd-420f2ea9b54b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:18.828810 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7d5a03eb-849e-40fe-aebd-420f2ea9b54b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:18.829326 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7d5a03eb-849e-40fe-aebd-420f2ea9b54b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:18.829745 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-7d5a03eb-849e-40fe-aebd-420f2ea9b54b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:18.859621 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-7d5a03eb-849e-40fe-aebd-420f2ea9b54b tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045597 Aug 24 10:28:18.860193 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 539/1068] 10.222.0.30 () {58 vars in 1302 bytes} [Wed Aug 24 10:28:18 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:28:18.871154 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:18.871664 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:18.878098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:18.878708 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:18.879174 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:18.879868 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:18.880322 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:18.880739 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:18.958215 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] HTTP exception thrown: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c is not attached to volume cb1846f8-b656-4bae-8e72-609fe9275f8d Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Request method failure captured: Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: DELETE /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments/cb1846f8-b656-4bae-8e72-609fe9275f8d HTTP/1.1 Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBfyn5f1FUCz6S9KsH1-vMsUmFH-2BAtKYzEHjwJDPlAFJx_-D6O2LhvQlQah3x3aJn2zZ6HZobOEYg2zqndKxxtBw5OIB1IS7z8oZq05jmWSJ7gtQhho5i5R2mcFZyFBMWPTRnCnUWFp2yyichH8QMWT7LLUGRxU_PIcAESMeci8ePc Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: e9980d2c52934ca38dfb4d3dfbf9700b Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-TestMinimumBasicScenario-960423814 Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:28:18.960583 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e9980d2c52934ca38dfb4d3dfbf9700b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e9980d2c52934ca38dfb4d3dfbf9700b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e9980d2c52934ca38dfb4d3dfbf9700b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e9980d2c52934ca38dfb4d3dfbf9700b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-TestMinimumBasicScenario-960423814 Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: e9980d2c52934ca38dfb4d3dfbf9700b Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-TestMinimumBasicScenario-960423814 Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-TestMinimumBasicScenario-960423814-project Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: 8744189102a44d47a3b994bfe49fd8e1 Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-TestMinimumBasicScenario-960423814-project Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:28:18.962057 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c is not attached to volume cb1846f8-b656-4bae-8e72-609fe9275f8d Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'server_id': '01fbc3df-348f-4e15-bb60-adef1d1ad97c', 'id': 'cb1846f8-b656-4bae-8e72-609fe9275f8d'} Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cb1846f8-b656-4bae-8e72-609fe9275f8d. Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:28:18.962829 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c is not attached to volume cb1846f8-b656-4bae-8e72-609fe9275f8d Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c is not attached to volume cb1846f8-b656-4bae-8e72-609fe9275f8d Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:28:18.964365 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Returning 404 to user: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c is not attached to volume cb1846f8-b656-4bae-8e72-609fe9275f8d {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:28:18.965813 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-bc461a01-4e8e-45c1-99cc-fabfbaa2c1d1 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "DELETE /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments/cb1846f8-b656-4bae-8e72-609fe9275f8d" status: 404 len: 154 microversion: 2.1 time: 0.094930 Aug 24 10:28:18.965813 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 530/1069] 10.222.0.30 () {58 vars in 1416 bytes} [Wed Aug 24 10:28:18 2022] DELETE /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c/os-volume_attachments/cb1846f8-b656-4bae-8e72-609fe9275f8d => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:28:20.256278 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3b501ef6-d65f-43be-85f6-9bdaa76f3265 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:20.260337 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3b501ef6-d65f-43be-85f6-9bdaa76f3265 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:20.263467 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b501ef6-d65f-43be-85f6-9bdaa76f3265 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:20.263983 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b501ef6-d65f-43be-85f6-9bdaa76f3265 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:20.264418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b501ef6-d65f-43be-85f6-9bdaa76f3265 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:20.265142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b501ef6-d65f-43be-85f6-9bdaa76f3265 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:20.265600 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b501ef6-d65f-43be-85f6-9bdaa76f3265 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:20.266027 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b501ef6-d65f-43be-85f6-9bdaa76f3265 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:20.293521 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3b501ef6-d65f-43be-85f6-9bdaa76f3265 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:28:20.660828 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3b501ef6-d65f-43be-85f6-9bdaa76f3265 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "DELETE /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 204 len: 0 microversion: 2.1 time: 0.407839 Aug 24 10:28:20.661385 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 540/1070] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:28:20 2022] DELETE /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:20.670305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-42503d4a-71b5-4dd5-a522-d266dde2c2cf tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:20.670952 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-42503d4a-71b5-4dd5-a522-d266dde2c2cf tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:20.678142 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-42503d4a-71b5-4dd5-a522-d266dde2c2cf tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:20.678615 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-42503d4a-71b5-4dd5-a522-d266dde2c2cf tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:20.679048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-42503d4a-71b5-4dd5-a522-d266dde2c2cf tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:20.679748 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-42503d4a-71b5-4dd5-a522-d266dde2c2cf tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:20.680200 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-42503d4a-71b5-4dd5-a522-d266dde2c2cf tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:20.680628 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-42503d4a-71b5-4dd5-a522-d266dde2c2cf tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:20.814519 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-42503d4a-71b5-4dd5-a522-d266dde2c2cf tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:20.822720 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-42503d4a-71b5-4dd5-a522-d266dde2c2cf tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1554 microversion: 2.1 time: 0.156369 Aug 24 10:28:20.823283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 531/1071] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:20 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:21.845467 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2baf65c6-01ea-444e-b0bd-a4718fffb967 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:21.846210 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2baf65c6-01ea-444e-b0bd-a4718fffb967 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:21.853700 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2baf65c6-01ea-444e-b0bd-a4718fffb967 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:21.854182 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2baf65c6-01ea-444e-b0bd-a4718fffb967 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:21.854621 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2baf65c6-01ea-444e-b0bd-a4718fffb967 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:21.855320 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2baf65c6-01ea-444e-b0bd-a4718fffb967 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:21.855779 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2baf65c6-01ea-444e-b0bd-a4718fffb967 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:21.856211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2baf65c6-01ea-444e-b0bd-a4718fffb967 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:21.987569 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2baf65c6-01ea-444e-b0bd-a4718fffb967 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:21.995483 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2baf65c6-01ea-444e-b0bd-a4718fffb967 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1554 microversion: 2.1 time: 0.154247 Aug 24 10:28:21.996047 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 541/1072] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:21 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:23.017877 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-fd78187a-677c-4878-aca6-5eceee2855a5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:23.018503 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-fd78187a-677c-4878-aca6-5eceee2855a5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:23.026023 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fd78187a-677c-4878-aca6-5eceee2855a5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.026521 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fd78187a-677c-4878-aca6-5eceee2855a5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.027021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fd78187a-677c-4878-aca6-5eceee2855a5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.027789 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fd78187a-677c-4878-aca6-5eceee2855a5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.028245 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fd78187a-677c-4878-aca6-5eceee2855a5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.028672 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-fd78187a-677c-4878-aca6-5eceee2855a5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.304598 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-fd78187a-677c-4878-aca6-5eceee2855a5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:23.314098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-fd78187a-677c-4878-aca6-5eceee2855a5 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1554 microversion: 2.1 time: 0.300792 Aug 24 10:28:23.314686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 532/1073] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:23 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1554 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:23.396906 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-9d9b1e29-abc4-4d89-a806-f07bc51dcc1c req-3316ecf9-5855-405d-b6b9-a21bc95495be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fbc3df-348f-4e15-bb60-adef1d1ad97c", "name": "network-vif-deleted", "tag": "9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:23.407411 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-9d9b1e29-abc4-4d89-a806-f07bc51dcc1c req-3316ecf9-5855-405d-b6b9-a21bc95495be service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:23.407883 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-9d9b1e29-abc4-4d89-a806-f07bc51dcc1c req-3316ecf9-5855-405d-b6b9-a21bc95495be service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:23.408304 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-9d9b1e29-abc4-4d89-a806-f07bc51dcc1c req-3316ecf9-5855-405d-b6b9-a21bc95495be service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:23.421103 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-9d9b1e29-abc4-4d89-a806-f07bc51dcc1c req-3316ecf9-5855-405d-b6b9-a21bc95495be service nova] Creating event network-vif-deleted:9f90577d-5c1b-4bdd-ad82-c6a7f250a1ad for instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c on hv-cinder-85427 Aug 24 10:28:23.425493 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-9d9b1e29-abc4-4d89-a806-f07bc51dcc1c req-3316ecf9-5855-405d-b6b9-a21bc95495be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033222 Aug 24 10:28:23.426054 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 542/1074] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:28:24.337008 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:24.337697 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:24.344292 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:24.344767 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:24.345234 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:24.345999 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:24.346448 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:24.346866 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:24.378750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:24.379225 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:24.380295 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:24.380745 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lazy-loading 'fault' on Instance uuid 01fbc3df-348f-4e15-bb60-adef1d1ad97c {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:28:24.422655 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8744189102a44d47a3b994bfe49fd8e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9980d2c52934ca38dfb4d3dfbf9700b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:28:24.430898 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-9836b9b1-8369-42ce-b2bd-7573d87dd91a tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 200 len: 1348 microversion: 2.1 time: 0.098410 Aug 24 10:28:24.431683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 533/1075] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:24 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:28:25.453179 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:25.453803 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [instance: 01fbc3df-348f-4e15-bb60-adef1d1ad97c] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:28:25.460679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:25.461182 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:25.461617 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:25.462309 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:28:25.462763 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:28:25.463181 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] HTTP exception thrown: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c could not be found. Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Request method failure captured: Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c HTTP/1.1 Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBfyn5f1FUCz6S9KsH1-vMsUmFH-2BAtKYzEHjwJDPlAFJx_-D6O2LhvQlQah3x3aJn2zZ6HZobOEYg2zqndKxxtBw5OIB1IS7z8oZq05jmWSJ7gtQhho5i5R2mcFZyFBMWPTRnCnUWFp2yyichH8QMWT7LLUGRxU_PIcAESMeci8ePc Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: e9980d2c52934ca38dfb4d3dfbf9700b Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-TestMinimumBasicScenario-960423814 Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:28:25.482313 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e9980d2c52934ca38dfb4d3dfbf9700b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e9980d2c52934ca38dfb4d3dfbf9700b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e9980d2c52934ca38dfb4d3dfbf9700b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e9980d2c52934ca38dfb4d3dfbf9700b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-TestMinimumBasicScenario-960423814 Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: e9980d2c52934ca38dfb4d3dfbf9700b Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-TestMinimumBasicScenario-960423814 Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-TestMinimumBasicScenario-960423814-project Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: 8744189102a44d47a3b994bfe49fd8e1 Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-TestMinimumBasicScenario-960423814-project Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c could not be found. Aug 24 10:28:25.483844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '01fbc3df-348f-4e15-bb60-adef1d1ad97c'} Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c could not be found. Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:28:25.484694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c could not be found. Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c could not be found. Aug 24 10:28:25.486113 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:28:25.487335 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Returning 404 to user: Instance 01fbc3df-348f-4e15-bb60-adef1d1ad97c could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:28:25.487335 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ac8ee504-63a9-46c5-b85c-01c360379ab8 tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c" status: 404 len: 111 microversion: 2.1 time: 0.034795 Aug 24 10:28:25.487335 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 543/1076] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:28:25 2022] GET /compute/v2.1/servers/01fbc3df-348f-4e15-bb60-adef1d1ad97c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:28:25.493007 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-17f3a764-51ff-4c09-a5a2-c54dfabcb2ce tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] Calling method '.version_select at 0x7f0af412aa60>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:28:25.497548 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR oslo.messaging._drivers.impl_rabbit [None req-17f3a764-51ff-4c09-a5a2-c54dfabcb2ce tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [f7f2e5a4-e945-4524-9539-d987688b529f] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:28:26.506959 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO oslo.messaging._drivers.impl_rabbit [None req-17f3a764-51ff-4c09-a5a2-c54dfabcb2ce tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] [f7f2e5a4-e945-4524-9539-d987688b529f] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 52662. Aug 24 10:28:26.586998 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-17f3a764-51ff-4c09-a5a2-c54dfabcb2ce tempest-TestMinimumBasicScenario-960423814 tempest-TestMinimumBasicScenario-960423814-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-539561095" status: 202 len: 0 microversion: 2.1 time: 1.097694 Aug 24 10:28:26.587575 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 534/1077] 10.222.0.30 () {58 vars in 1269 bytes} [Wed Aug 24 10:28:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-539561095 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:28:50.288146 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:50.289557 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:50.446785 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-5b917976-c388-473f-9086-fd6d4cac9cea tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Action: 'create', calling method: .version_select at 0x7f0af41f9280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-894496397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJiS5ILUNSqpNNN0wf6ytACPtNNEH7VAoz5jEQUIeiDEaIJueA3bbUB4qlS7tOQ0TGOdDT9SJoV+32Y0TkXuDC9dX4Hf7A5F3nAFmM0rZ4R3HFLunbCr+xUVOX+sGqaBg=="}} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:28:50.463225 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-5b917976-c388-473f-9086-fd6d4cac9cea tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Getting quotas for project 8013ed9ae5ed46b9bc656f193c43e118. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:28:50.467364 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.quota [None req-5b917976-c388-473f-9086-fd6d4cac9cea tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Getting quotas for user a71f15d0547a4d78b6d540e5eb5b2fbc and project 8013ed9ae5ed46b9bc656f193c43e118. Resources: {'key_pairs'} {{(pid=121271) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:28:50.551761 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-5b917976-c388-473f-9086-fd6d4cac9cea tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.268950 Aug 24 10:28:50.552273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 544/1078] 10.222.0.30 () {60 vars in 1159 bytes} [Wed Aug 24 10:28:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:09.162032 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.162802 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.166832 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-640175505", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-894496397", "security_groups": [{"name": "tempest-secgroup-smoke-428591116"}], "block_device_mapping_v2": [{"uuid": "287ef9fd-4198-4a99-8395-90e7f8569d3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b1a677a-6846-4fad-a355-51b4933f0eab"}]}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:09.297520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] validate_networks() for [('2b1a677a-6846-4fad-a355-51b4933f0eab', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:29:09.766843 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:29:09.767263 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:29:09.767729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:29:09.768130 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:29:09.768538 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:29:09.777801 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:09.778453 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:09.778888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:09.779638 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:09.780092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:09.780509 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:09.798079 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Getting quotas for project 8013ed9ae5ed46b9bc656f193c43e118. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:29:09.802394 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Getting quotas for user a71f15d0547a4d78b6d540e5eb5b2fbc and project 8013ed9ae5ed46b9bc656f193c43e118. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:29:09.863266 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:29:09.865517 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='287ef9fd-4198-4a99-8395-90e7f8569d3b',volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:29:10.442888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0a101bef-ab0d-4c87-b72d-b10b882c392f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.282366 Aug 24 10:29:10.443571 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 535/1079] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:29:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:29:10.453036 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=4 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:10.453873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:10.457741 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e56ebaac-17ee-4a02-a94a-3e45cdccaad3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:10.458368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e56ebaac-17ee-4a02-a94a-3e45cdccaad3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:10.520564 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e56ebaac-17ee-4a02-a94a-3e45cdccaad3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:10.529234 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e56ebaac-17ee-4a02-a94a-3e45cdccaad3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1093 microversion: 2.1 time: 0.077477 Aug 24 10:29:10.529820 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 545/1080] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:10 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:11.550310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c21d5e48-fc90-4980-b343-3406cf3d0ef4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:11.550867 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c21d5e48-fc90-4980-b343-3406cf3d0ef4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:11.604127 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c21d5e48-fc90-4980-b343-3406cf3d0ef4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:11.611387 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c21d5e48-fc90-4980-b343-3406cf3d0ef4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1093 microversion: 2.1 time: 0.065602 Aug 24 10:29:11.611949 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 536/1081] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:11 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:12.631904 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-bbd7896f-ba22-42c4-ace8-6c327ab82c3f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:12.632850 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-bbd7896f-ba22-42c4-ace8-6c327ab82c3f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:12.641073 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbd7896f-ba22-42c4-ace8-6c327ab82c3f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:12.641938 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbd7896f-ba22-42c4-ace8-6c327ab82c3f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:12.642374 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbd7896f-ba22-42c4-ace8-6c327ab82c3f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:12.643073 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbd7896f-ba22-42c4-ace8-6c327ab82c3f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:12.643525 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbd7896f-ba22-42c4-ace8-6c327ab82c3f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:12.643943 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-bbd7896f-ba22-42c4-ace8-6c327ab82c3f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:12.706913 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-bbd7896f-ba22-42c4-ace8-6c327ab82c3f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:12.714739 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-bbd7896f-ba22-42c4-ace8-6c327ab82c3f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1191 microversion: 2.1 time: 0.086974 Aug 24 10:29:12.715312 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 546/1082] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:12 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:13.736678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8d9c90c1-f159-4bb6-b0df-b8bb2ceb2091 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:13.737310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8d9c90c1-f159-4bb6-b0df-b8bb2ceb2091 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:13.744582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8d9c90c1-f159-4bb6-b0df-b8bb2ceb2091 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:13.745095 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8d9c90c1-f159-4bb6-b0df-b8bb2ceb2091 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:13.745530 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8d9c90c1-f159-4bb6-b0df-b8bb2ceb2091 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:13.746625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8d9c90c1-f159-4bb6-b0df-b8bb2ceb2091 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:13.747308 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8d9c90c1-f159-4bb6-b0df-b8bb2ceb2091 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:13.747901 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8d9c90c1-f159-4bb6-b0df-b8bb2ceb2091 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:13.845361 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8d9c90c1-f159-4bb6-b0df-b8bb2ceb2091 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:13.853366 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8d9c90c1-f159-4bb6-b0df-b8bb2ceb2091 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1209 microversion: 2.1 time: 0.121115 Aug 24 10:29:13.853944 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 537/1083] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:13 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:14.874970 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-5a9add27-897a-4d24-a3d8-89c3dca715d3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:14.875686 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-5a9add27-897a-4d24-a3d8-89c3dca715d3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:14.883752 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a9add27-897a-4d24-a3d8-89c3dca715d3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:14.884372 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a9add27-897a-4d24-a3d8-89c3dca715d3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:14.884892 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a9add27-897a-4d24-a3d8-89c3dca715d3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:14.885793 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a9add27-897a-4d24-a3d8-89c3dca715d3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:14.886260 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a9add27-897a-4d24-a3d8-89c3dca715d3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:14.886684 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-5a9add27-897a-4d24-a3d8-89c3dca715d3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:15.026236 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-5a9add27-897a-4d24-a3d8-89c3dca715d3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:15.033806 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-5a9add27-897a-4d24-a3d8-89c3dca715d3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.163121 Aug 24 10:29:15.035227 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 547/1084] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:14 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:15.117468 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-a817bb29-cb5b-42a6-a1d7-801a6c728743 req-dea37af0-c352-4396-ae74-10fb12162a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a33e3c-4ed3-4aa3-9a74-0188df168459", "tag": "a6bd2839-457d-4435-8bb3-220bff657afc"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:15.128097 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-a817bb29-cb5b-42a6-a1d7-801a6c728743 req-dea37af0-c352-4396-ae74-10fb12162a9c service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:15.128712 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-a817bb29-cb5b-42a6-a1d7-801a6c728743 req-dea37af0-c352-4396-ae74-10fb12162a9c service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:15.129232 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-a817bb29-cb5b-42a6-a1d7-801a6c728743 req-dea37af0-c352-4396-ae74-10fb12162a9c service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:15.140792 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-a817bb29-cb5b-42a6-a1d7-801a6c728743 req-dea37af0-c352-4396-ae74-10fb12162a9c service nova] Creating event network-changed:a6bd2839-457d-4435-8bb3-220bff657afc for instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 on hv-cinder-85427 Aug 24 10:29:15.146173 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-a817bb29-cb5b-42a6-a1d7-801a6c728743 req-dea37af0-c352-4396-ae74-10fb12162a9c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032438 Aug 24 10:29:15.146819 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 538/1085] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:16.054766 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-80482e0e-13ea-4597-8c08-14e43e0a5f1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:16.055385 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-80482e0e-13ea-4597-8c08-14e43e0a5f1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:16.062309 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80482e0e-13ea-4597-8c08-14e43e0a5f1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.062789 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80482e0e-13ea-4597-8c08-14e43e0a5f1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.063221 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80482e0e-13ea-4597-8c08-14e43e0a5f1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.063912 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80482e0e-13ea-4597-8c08-14e43e0a5f1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:16.064392 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80482e0e-13ea-4597-8c08-14e43e0a5f1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:16.064816 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-80482e0e-13ea-4597-8c08-14e43e0a5f1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:16.194701 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-80482e0e-13ea-4597-8c08-14e43e0a5f1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:16.202844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-80482e0e-13ea-4597-8c08-14e43e0a5f1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.152121 Aug 24 10:29:16.203417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 548/1086] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:16 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:17.225424 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-47d239d7-8d01-4ccf-9cbf-e54aabcd3ae4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:17.226403 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-47d239d7-8d01-4ccf-9cbf-e54aabcd3ae4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:17.232759 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47d239d7-8d01-4ccf-9cbf-e54aabcd3ae4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:17.233276 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47d239d7-8d01-4ccf-9cbf-e54aabcd3ae4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:17.233712 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47d239d7-8d01-4ccf-9cbf-e54aabcd3ae4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:17.234407 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47d239d7-8d01-4ccf-9cbf-e54aabcd3ae4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:17.234857 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47d239d7-8d01-4ccf-9cbf-e54aabcd3ae4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:17.235283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-47d239d7-8d01-4ccf-9cbf-e54aabcd3ae4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:17.368364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-47d239d7-8d01-4ccf-9cbf-e54aabcd3ae4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:17.376226 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-47d239d7-8d01-4ccf-9cbf-e54aabcd3ae4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.155562 Aug 24 10:29:17.377253 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 539/1087] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:17 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:18.397007 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2dc89950-b755-4961-9bd2-dfe404cdd372 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:18.397618 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2dc89950-b755-4961-9bd2-dfe404cdd372 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:18.404995 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2dc89950-b755-4961-9bd2-dfe404cdd372 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:18.405477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2dc89950-b755-4961-9bd2-dfe404cdd372 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:18.405906 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2dc89950-b755-4961-9bd2-dfe404cdd372 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:18.406689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2dc89950-b755-4961-9bd2-dfe404cdd372 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:18.407146 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2dc89950-b755-4961-9bd2-dfe404cdd372 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:18.407587 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2dc89950-b755-4961-9bd2-dfe404cdd372 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:18.543409 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2dc89950-b755-4961-9bd2-dfe404cdd372 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:18.551145 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2dc89950-b755-4961-9bd2-dfe404cdd372 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.158001 Aug 24 10:29:18.551642 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 549/1088] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:18 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:19.572750 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3c30ae67-4069-441f-91ed-0c3bc8c4f872 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:19.573310 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3c30ae67-4069-441f-91ed-0c3bc8c4f872 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:19.580485 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3c30ae67-4069-441f-91ed-0c3bc8c4f872 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:19.581078 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3c30ae67-4069-441f-91ed-0c3bc8c4f872 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:19.581524 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3c30ae67-4069-441f-91ed-0c3bc8c4f872 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:19.582226 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3c30ae67-4069-441f-91ed-0c3bc8c4f872 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:19.582682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3c30ae67-4069-441f-91ed-0c3bc8c4f872 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:19.583108 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3c30ae67-4069-441f-91ed-0c3bc8c4f872 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:19.717753 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3c30ae67-4069-441f-91ed-0c3bc8c4f872 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:19.725607 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3c30ae67-4069-441f-91ed-0c3bc8c4f872 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.156888 Aug 24 10:29:19.726453 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 540/1089] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:19 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:20.746781 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-218f90e0-76a9-49d7-839e-ae7d15976f4b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:20.747413 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-218f90e0-76a9-49d7-839e-ae7d15976f4b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:20.749821 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:20.754515 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-218f90e0-76a9-49d7-839e-ae7d15976f4b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:20.754989 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-218f90e0-76a9-49d7-839e-ae7d15976f4b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:20.755417 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-218f90e0-76a9-49d7-839e-ae7d15976f4b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:20.756105 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-218f90e0-76a9-49d7-839e-ae7d15976f4b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:20.756602 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-218f90e0-76a9-49d7-839e-ae7d15976f4b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:20.757051 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-218f90e0-76a9-49d7-839e-ae7d15976f4b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:20.888196 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-218f90e0-76a9-49d7-839e-ae7d15976f4b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:20.895940 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-218f90e0-76a9-49d7-839e-ae7d15976f4b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.153728 Aug 24 10:29:20.896548 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 550/1090] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:20 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:21.917705 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1e846b4b-8559-43a4-867f-a5f1339f2145 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:21.918587 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1e846b4b-8559-43a4-867f-a5f1339f2145 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:21.920518 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:21.921247 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=8 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:21.925903 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e846b4b-8559-43a4-867f-a5f1339f2145 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:21.926378 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e846b4b-8559-43a4-867f-a5f1339f2145 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:21.926803 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e846b4b-8559-43a4-867f-a5f1339f2145 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:21.927491 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e846b4b-8559-43a4-867f-a5f1339f2145 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:21.927932 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e846b4b-8559-43a4-867f-a5f1339f2145 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:21.928347 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e846b4b-8559-43a4-867f-a5f1339f2145 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:22.070503 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1e846b4b-8559-43a4-867f-a5f1339f2145 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:22.078640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1e846b4b-8559-43a4-867f-a5f1339f2145 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.165206 Aug 24 10:29:22.079233 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 541/1091] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:21 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:23.105419 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-3b59a44d-3b63-49f5-9b2d-5d3f3576c996 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:23.107453 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-3b59a44d-3b63-49f5-9b2d-5d3f3576c996 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:23.117966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b59a44d-3b63-49f5-9b2d-5d3f3576c996 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:23.118827 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b59a44d-3b63-49f5-9b2d-5d3f3576c996 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:23.119625 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b59a44d-3b63-49f5-9b2d-5d3f3576c996 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:23.122273 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b59a44d-3b63-49f5-9b2d-5d3f3576c996 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:23.123131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b59a44d-3b63-49f5-9b2d-5d3f3576c996 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:23.123925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-3b59a44d-3b63-49f5-9b2d-5d3f3576c996 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:23.281635 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-3b59a44d-3b63-49f5-9b2d-5d3f3576c996 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:23.289535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-3b59a44d-3b63-49f5-9b2d-5d3f3576c996 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.193568 Aug 24 10:29:23.290102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 551/1092] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:23 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:24.313210 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-4fa473b5-c7e4-40bc-911f-622cd1908bce tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:24.313824 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-4fa473b5-c7e4-40bc-911f-622cd1908bce tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:24.320213 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa473b5-c7e4-40bc-911f-622cd1908bce tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:24.320690 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa473b5-c7e4-40bc-911f-622cd1908bce tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:24.321158 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa473b5-c7e4-40bc-911f-622cd1908bce tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:24.321845 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa473b5-c7e4-40bc-911f-622cd1908bce tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:24.322298 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa473b5-c7e4-40bc-911f-622cd1908bce tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:24.322717 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-4fa473b5-c7e4-40bc-911f-622cd1908bce tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:24.465068 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-4fa473b5-c7e4-40bc-911f-622cd1908bce tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:24.472844 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-4fa473b5-c7e4-40bc-911f-622cd1908bce tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.163558 Aug 24 10:29:24.473432 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 542/1093] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:24 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:25.341029 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-f82d5fec-9f4d-434e-b5f3-7580e5a8bd0a req-1be0e043-82b7-4841-8d02-c38fbd977467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a33e3c-4ed3-4aa3-9a74-0188df168459", "name": "network-vif-plugged", "status": "completed", "tag": "a6bd2839-457d-4435-8bb3-220bff657afc"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:25.350507 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f82d5fec-9f4d-434e-b5f3-7580e5a8bd0a req-1be0e043-82b7-4841-8d02-c38fbd977467 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:25.351243 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f82d5fec-9f4d-434e-b5f3-7580e5a8bd0a req-1be0e043-82b7-4841-8d02-c38fbd977467 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:25.351671 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-f82d5fec-9f4d-434e-b5f3-7580e5a8bd0a req-1be0e043-82b7-4841-8d02-c38fbd977467 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:25.364229 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-f82d5fec-9f4d-434e-b5f3-7580e5a8bd0a req-1be0e043-82b7-4841-8d02-c38fbd977467 service nova] Creating event network-vif-plugged:a6bd2839-457d-4435-8bb3-220bff657afc for instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 on hv-cinder-85427 Aug 24 10:29:25.371262 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-f82d5fec-9f4d-434e-b5f3-7580e5a8bd0a req-1be0e043-82b7-4841-8d02-c38fbd977467 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097668 Aug 24 10:29:25.371262 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 552/1094] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:29:25.494787 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a6eb51dd-c194-4f38-a591-801ef52da981 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:25.496146 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a6eb51dd-c194-4f38-a591-801ef52da981 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:25.503679 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6eb51dd-c194-4f38-a591-801ef52da981 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:25.504169 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6eb51dd-c194-4f38-a591-801ef52da981 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:25.504605 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6eb51dd-c194-4f38-a591-801ef52da981 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:25.505343 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6eb51dd-c194-4f38-a591-801ef52da981 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:25.505819 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6eb51dd-c194-4f38-a591-801ef52da981 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:25.506225 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a6eb51dd-c194-4f38-a591-801ef52da981 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:25.659400 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a6eb51dd-c194-4f38-a591-801ef52da981 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:25.667704 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a6eb51dd-c194-4f38-a591-801ef52da981 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.176364 Aug 24 10:29:25.668271 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 543/1095] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:25 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:26.689424 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-44dccb00-295d-4471-9702-b45bb5653933 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:26.690185 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-44dccb00-295d-4471-9702-b45bb5653933 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:26.696366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44dccb00-295d-4471-9702-b45bb5653933 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:26.696851 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44dccb00-295d-4471-9702-b45bb5653933 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:26.697317 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44dccb00-295d-4471-9702-b45bb5653933 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:26.698015 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44dccb00-295d-4471-9702-b45bb5653933 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:26.699088 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44dccb00-295d-4471-9702-b45bb5653933 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:26.699850 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-44dccb00-295d-4471-9702-b45bb5653933 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:26.835161 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-44dccb00-295d-4471-9702-b45bb5653933 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:26.842780 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-44dccb00-295d-4471-9702-b45bb5653933 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1264 microversion: 2.1 time: 0.158053 Aug 24 10:29:26.843487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 553/1096] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:26 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:27.863972 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a964467c-9067-49bf-bcd9-214430d5471c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:27.864576 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a964467c-9067-49bf-bcd9-214430d5471c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:27.871294 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a964467c-9067-49bf-bcd9-214430d5471c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:27.871774 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a964467c-9067-49bf-bcd9-214430d5471c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:27.872212 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a964467c-9067-49bf-bcd9-214430d5471c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:27.872922 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a964467c-9067-49bf-bcd9-214430d5471c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:27.873376 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a964467c-9067-49bf-bcd9-214430d5471c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:27.873798 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a964467c-9067-49bf-bcd9-214430d5471c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:28.006573 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a964467c-9067-49bf-bcd9-214430d5471c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:28.015100 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a964467c-9067-49bf-bcd9-214430d5471c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1452 microversion: 2.1 time: 0.155122 Aug 24 10:29:28.015683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 544/1097] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:27 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:28.037610 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-2fe21a78-588e-4a22-812a-3e5c05962056 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:29:28.038256 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-2fe21a78-588e-4a22-812a-3e5c05962056 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:29:28.045275 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fe21a78-588e-4a22-812a-3e5c05962056 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:28.045757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fe21a78-588e-4a22-812a-3e5c05962056 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:28.046186 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fe21a78-588e-4a22-812a-3e5c05962056 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:28.046862 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fe21a78-588e-4a22-812a-3e5c05962056 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:28.047309 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fe21a78-588e-4a22-812a-3e5c05962056 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:28.047726 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-2fe21a78-588e-4a22-812a-3e5c05962056 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:28.178660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-2fe21a78-588e-4a22-812a-3e5c05962056 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:29:28.187142 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-2fe21a78-588e-4a22-812a-3e5c05962056 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1452 microversion: 2.1 time: 0.153335 Aug 24 10:29:28.187916 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 554/1098] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:29:28 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:30.175930 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-642a514d-3870-4481-9aae-bb5d87823134 req-23d3ff63-a162-430c-8931-08a795840c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a33e3c-4ed3-4aa3-9a74-0188df168459", "tag": "a6bd2839-457d-4435-8bb3-220bff657afc"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:29:30.186166 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-642a514d-3870-4481-9aae-bb5d87823134 req-23d3ff63-a162-430c-8931-08a795840c1c service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:29:30.186642 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-642a514d-3870-4481-9aae-bb5d87823134 req-23d3ff63-a162-430c-8931-08a795840c1c service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:29:30.187072 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-642a514d-3870-4481-9aae-bb5d87823134 req-23d3ff63-a162-430c-8931-08a795840c1c service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:29:30.199358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-642a514d-3870-4481-9aae-bb5d87823134 req-23d3ff63-a162-430c-8931-08a795840c1c service nova] Creating event network-changed:a6bd2839-457d-4435-8bb3-220bff657afc for instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 on hv-cinder-85427 Aug 24 10:29:30.204501 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-642a514d-3870-4481-9aae-bb5d87823134 req-23d3ff63-a162-430c-8931-08a795840c1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032284 Aug 24 10:29:30.205346 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 545/1099] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:30:31.283093 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:30:31.283868 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Wed Aug 24 10:30:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:31:25.461663 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR oslo.messaging._drivers.impl_rabbit [-] [be65e45a-7d81-4d08-942f-54b6dc3f8363] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 10:31:25.462464 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=22 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:25.463239 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=50 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:25.467076 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b76da284-6c38-48dd-8a05-3cd43d12076c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:25.470293 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b76da284-6c38-48dd-8a05-3cd43d12076c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:25.473597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b76da284-6c38-48dd-8a05-3cd43d12076c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:25.474077 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b76da284-6c38-48dd-8a05-3cd43d12076c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:25.474535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b76da284-6c38-48dd-8a05-3cd43d12076c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:25.475219 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b76da284-6c38-48dd-8a05-3cd43d12076c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:25.475952 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b76da284-6c38-48dd-8a05-3cd43d12076c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:25.476529 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b76da284-6c38-48dd-8a05-3cd43d12076c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:25.502541 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b76da284-6c38-48dd-8a05-3cd43d12076c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:31:25.849089 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b76da284-6c38-48dd-8a05-3cd43d12076c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "DELETE /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 204 len: 0 microversion: 2.1 time: 0.389180 Aug 24 10:31:25.864669 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 555/1100] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:31:25 2022] DELETE /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:31:25.864847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:25.864847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=48 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:25.864847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-da3564d7-855a-4d9f-9c54-ca789b560063 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:25.864847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-da3564d7-855a-4d9f-9c54-ca789b560063 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:25.868056 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da3564d7-855a-4d9f-9c54-ca789b560063 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:25.868545 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da3564d7-855a-4d9f-9c54-ca789b560063 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:25.869142 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da3564d7-855a-4d9f-9c54-ca789b560063 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:25.869851 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da3564d7-855a-4d9f-9c54-ca789b560063 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:25.870469 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da3564d7-855a-4d9f-9c54-ca789b560063 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:25.870769 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da3564d7-855a-4d9f-9c54-ca789b560063 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:26.008592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-da3564d7-855a-4d9f-9c54-ca789b560063 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:26.016578 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-da3564d7-855a-4d9f-9c54-ca789b560063 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1577 microversion: 2.1 time: 0.162220 Aug 24 10:31:26.022853 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 546/1101] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:25 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:27.039375 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-225eee1b-8050-4020-80da-8e15073c6b11 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:27.040100 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-225eee1b-8050-4020-80da-8e15073c6b11 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:27.047845 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-225eee1b-8050-4020-80da-8e15073c6b11 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:27.048321 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-225eee1b-8050-4020-80da-8e15073c6b11 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:27.048749 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-225eee1b-8050-4020-80da-8e15073c6b11 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:27.049463 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-225eee1b-8050-4020-80da-8e15073c6b11 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:27.049910 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-225eee1b-8050-4020-80da-8e15073c6b11 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:27.050327 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-225eee1b-8050-4020-80da-8e15073c6b11 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:27.058646 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] [be65e45a-7d81-4d08-942f-54b6dc3f8363] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 53056. Aug 24 10:31:27.192649 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-225eee1b-8050-4020-80da-8e15073c6b11 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:27.201165 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-225eee1b-8050-4020-80da-8e15073c6b11 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1577 microversion: 2.1 time: 0.166584 Aug 24 10:31:27.201908 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 556/1102] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:27 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:28.223068 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-e011bca4-4093-4fa3-8e09-959ac31cf136 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:28.223676 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-e011bca4-4093-4fa3-8e09-959ac31cf136 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:28.231609 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e011bca4-4093-4fa3-8e09-959ac31cf136 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:28.232094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e011bca4-4093-4fa3-8e09-959ac31cf136 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:28.232533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e011bca4-4093-4fa3-8e09-959ac31cf136 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:28.233267 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e011bca4-4093-4fa3-8e09-959ac31cf136 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:28.233788 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e011bca4-4093-4fa3-8e09-959ac31cf136 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:28.234271 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-e011bca4-4093-4fa3-8e09-959ac31cf136 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:28.383555 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-e011bca4-4093-4fa3-8e09-959ac31cf136 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:28.392059 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-e011bca4-4093-4fa3-8e09-959ac31cf136 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1577 microversion: 2.1 time: 0.173737 Aug 24 10:31:28.392634 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 547/1103] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:28 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:28.699747 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-fb6bfe9a-c6a6-4caa-97f0-77dd164fa4cf req-17c6a1e3-eee6-4abb-a16c-07cf28889556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a33e3c-4ed3-4aa3-9a74-0188df168459", "name": "network-vif-deleted", "tag": "a6bd2839-457d-4435-8bb3-220bff657afc"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:28.710251 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fb6bfe9a-c6a6-4caa-97f0-77dd164fa4cf req-17c6a1e3-eee6-4abb-a16c-07cf28889556 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:28.711584 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fb6bfe9a-c6a6-4caa-97f0-77dd164fa4cf req-17c6a1e3-eee6-4abb-a16c-07cf28889556 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:28.712014 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fb6bfe9a-c6a6-4caa-97f0-77dd164fa4cf req-17c6a1e3-eee6-4abb-a16c-07cf28889556 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:28.724048 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-fb6bfe9a-c6a6-4caa-97f0-77dd164fa4cf req-17c6a1e3-eee6-4abb-a16c-07cf28889556 service nova] Creating event network-vif-deleted:a6bd2839-457d-4435-8bb3-220bff657afc for instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 on hv-cinder-85427 Aug 24 10:31:28.730796 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-fb6bfe9a-c6a6-4caa-97f0-77dd164fa4cf req-17c6a1e3-eee6-4abb-a16c-07cf28889556 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035229 Aug 24 10:31:28.731719 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 557/1104] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:29.419592 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d00f5992-7b7c-479f-ba66-ed192e0caf6c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:29.420383 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d00f5992-7b7c-479f-ba66-ed192e0caf6c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:29.427754 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d00f5992-7b7c-479f-ba66-ed192e0caf6c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:29.432834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d00f5992-7b7c-479f-ba66-ed192e0caf6c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:29.432834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d00f5992-7b7c-479f-ba66-ed192e0caf6c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:29.432834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d00f5992-7b7c-479f-ba66-ed192e0caf6c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:29.432834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d00f5992-7b7c-479f-ba66-ed192e0caf6c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:29.433498 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d00f5992-7b7c-479f-ba66-ed192e0caf6c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:29.507421 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d00f5992-7b7c-479f-ba66-ed192e0caf6c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:29.515823 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d00f5992-7b7c-479f-ba66-ed192e0caf6c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 200 len: 1224 microversion: 2.1 time: 0.104492 Aug 24 10:31:29.516408 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 548/1105] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:29 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:30.538018 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:30.539258 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:30.545951 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:30.546440 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:30.546873 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:30.547572 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:30.548102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:30.548535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:30.562965 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] HTTP exception thrown: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Request method failure captured: Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 HTTP/1.1 Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBf1bstjXJc1Ndk0FtZNI0N0MKVbFdRfgYT511MNAX2pW4qzAlQgo2omaW54zNgMI-cTpa6NNvQWP3-o4TTF_iNSnWWu7blOTAfUOf_djzc-PJCnrLwxMEi1hB81bTk5OzQFx_fM-R6f70w0498gcp0D_AIpT06zWdm-EDzjjPjt8KqU Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8013ed9ae5ed46b9bc656f193c43e118 Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:31:30.564607 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8013ed9ae5ed46b9bc656f193c43e118", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8013ed9ae5ed46b9bc656f193c43e118 Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-TestVolumeBootPattern-1998904815-project Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: a71f15d0547a4d78b6d540e5eb5b2fbc Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-TestVolumeBootPattern-1998904815-project Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:31:30.566575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '35a33e3c-4ed3-4aa3-9a74-0188df168459'} Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:31:30.567822 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:31:30.569604 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:31:30.571317 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Returning 404 to user: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:31:30.571317 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f7daccc1-605d-4474-9a5a-24dd257fbef8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 404 len: 111 microversion: 2.1 time: 0.032490 Aug 24 10:31:30.571317 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 558/1106] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:30 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:31:30.617240 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-897697804", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-894496397", "security_groups": [{"name": "tempest-secgroup-smoke-428591116"}], "block_device_mapping_v2": [{"uuid": "287ef9fd-4198-4a99-8395-90e7f8569d3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b1a677a-6846-4fad-a355-51b4933f0eab"}]}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:30.731667 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] validate_networks() for [('2b1a677a-6846-4fad-a355-51b4933f0eab', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:31:31.099246 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:31:31.099675 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:31:31.100185 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:31:31.100595 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:31:31.101969 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:31:31.111112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:31.111596 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:31.112033 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:31.112992 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:31.113451 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:31.113879 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:31.131487 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Getting quotas for project 8013ed9ae5ed46b9bc656f193c43e118. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:31:31.135515 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Getting quotas for user a71f15d0547a4d78b6d540e5eb5b2fbc and project 8013ed9ae5ed46b9bc656f193c43e118. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:31:31.194262 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:31:31.196511 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='287ef9fd-4198-4a99-8395-90e7f8569d3b',volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:31:31.703048 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1e869a32-6be9-46ec-90c8-5dc435360843 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.090160 Aug 24 10:31:31.704061 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 549/1107] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:31:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:31:31.715477 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-f2d7dbf2-2e54-45e4-a95b-d981561a93a9 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:31.716190 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-f2d7dbf2-2e54-45e4-a95b-d981561a93a9 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:31.774393 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-f2d7dbf2-2e54-45e4-a95b-d981561a93a9 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:31.782233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-f2d7dbf2-2e54-45e4-a95b-d981561a93a9 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1093 microversion: 2.1 time: 0.071389 Aug 24 10:31:31.782765 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 559/1108] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:31 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:32.803625 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-39cc4fa1-1037-4ff5-87ed-06ea0ad6d1c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:32.804241 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-39cc4fa1-1037-4ff5-87ed-06ea0ad6d1c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:32.811786 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39cc4fa1-1037-4ff5-87ed-06ea0ad6d1c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:32.812274 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39cc4fa1-1037-4ff5-87ed-06ea0ad6d1c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:32.812753 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39cc4fa1-1037-4ff5-87ed-06ea0ad6d1c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:32.813467 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39cc4fa1-1037-4ff5-87ed-06ea0ad6d1c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:32.813924 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39cc4fa1-1037-4ff5-87ed-06ea0ad6d1c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:32.814348 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39cc4fa1-1037-4ff5-87ed-06ea0ad6d1c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:32.876996 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-39cc4fa1-1037-4ff5-87ed-06ea0ad6d1c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:32.885976 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-39cc4fa1-1037-4ff5-87ed-06ea0ad6d1c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1143 microversion: 2.1 time: 0.086803 Aug 24 10:31:32.886557 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 550/1109] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:32 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:33.907333 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-e163fbee-7610-475e-b90e-699bd2f2da6d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:33.907968 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-e163fbee-7610-475e-b90e-699bd2f2da6d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:33.914827 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e163fbee-7610-475e-b90e-699bd2f2da6d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:33.915322 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e163fbee-7610-475e-b90e-699bd2f2da6d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:33.915757 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e163fbee-7610-475e-b90e-699bd2f2da6d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:33.916555 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e163fbee-7610-475e-b90e-699bd2f2da6d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:33.917061 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e163fbee-7610-475e-b90e-699bd2f2da6d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:33.917494 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-e163fbee-7610-475e-b90e-699bd2f2da6d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:33.981102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-e163fbee-7610-475e-b90e-699bd2f2da6d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:33.989059 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-e163fbee-7610-475e-b90e-699bd2f2da6d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1191 microversion: 2.1 time: 0.085954 Aug 24 10:31:33.989625 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 560/1110] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:33 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:35.016139 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-a73f7cf6-1a97-4bd2-9d3a-f2947e197c79 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:35.017021 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-a73f7cf6-1a97-4bd2-9d3a-f2947e197c79 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:35.023895 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a73f7cf6-1a97-4bd2-9d3a-f2947e197c79 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:35.024683 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a73f7cf6-1a97-4bd2-9d3a-f2947e197c79 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:35.025784 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a73f7cf6-1a97-4bd2-9d3a-f2947e197c79 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:35.026502 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a73f7cf6-1a97-4bd2-9d3a-f2947e197c79 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:35.027088 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a73f7cf6-1a97-4bd2-9d3a-f2947e197c79 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:35.027670 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-a73f7cf6-1a97-4bd2-9d3a-f2947e197c79 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:35.268993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-a73f7cf6-1a97-4bd2-9d3a-f2947e197c79 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:35.279029 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-a73f7cf6-1a97-4bd2-9d3a-f2947e197c79 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1276 microversion: 2.1 time: 0.266773 Aug 24 10:31:35.279686 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 551/1111] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:35 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1276 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:35.851736 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-ad406fc4-eae1-413b-a2c2-212b43af0383 req-683a720f-71b9-4c80-bfea-8822ec44b40a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51ea99a-77b4-4634-81d9-9336811c57e8", "tag": "4521639c-8ab3-4078-b005-8055730c1867"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:35.870949 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-ad406fc4-eae1-413b-a2c2-212b43af0383 req-683a720f-71b9-4c80-bfea-8822ec44b40a service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:35.871844 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-ad406fc4-eae1-413b-a2c2-212b43af0383 req-683a720f-71b9-4c80-bfea-8822ec44b40a service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:35.872627 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-ad406fc4-eae1-413b-a2c2-212b43af0383 req-683a720f-71b9-4c80-bfea-8822ec44b40a service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:35.893357 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-ad406fc4-eae1-413b-a2c2-212b43af0383 req-683a720f-71b9-4c80-bfea-8822ec44b40a service nova] Creating event network-changed:4521639c-8ab3-4078-b005-8055730c1867 for instance b51ea99a-77b4-4634-81d9-9336811c57e8 on hv-cinder-85427 Aug 24 10:31:35.901511 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-ad406fc4-eae1-413b-a2c2-212b43af0383 req-683a720f-71b9-4c80-bfea-8822ec44b40a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056273 Aug 24 10:31:35.902197 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 561/1112] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:36.301231 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-d53a8723-803e-4691-ac44-2593f01d0a10 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:36.301996 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-d53a8723-803e-4691-ac44-2593f01d0a10 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:36.310975 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d53a8723-803e-4691-ac44-2593f01d0a10 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:36.311529 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d53a8723-803e-4691-ac44-2593f01d0a10 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:36.312138 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d53a8723-803e-4691-ac44-2593f01d0a10 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:36.312880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d53a8723-803e-4691-ac44-2593f01d0a10 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:36.313327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d53a8723-803e-4691-ac44-2593f01d0a10 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:36.313770 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-d53a8723-803e-4691-ac44-2593f01d0a10 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:36.519227 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-d53a8723-803e-4691-ac44-2593f01d0a10 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:36.527865 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-d53a8723-803e-4691-ac44-2593f01d0a10 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1264 microversion: 2.1 time: 0.230443 Aug 24 10:31:36.528364 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 552/1113] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:36 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:37.551128 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-0b782fb1-5794-42fc-b69c-c31ce96d17d5 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:37.551767 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-0b782fb1-5794-42fc-b69c-c31ce96d17d5 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:37.558212 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0b782fb1-5794-42fc-b69c-c31ce96d17d5 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:37.558694 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0b782fb1-5794-42fc-b69c-c31ce96d17d5 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:37.559131 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0b782fb1-5794-42fc-b69c-c31ce96d17d5 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:37.559845 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0b782fb1-5794-42fc-b69c-c31ce96d17d5 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:37.560301 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0b782fb1-5794-42fc-b69c-c31ce96d17d5 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:37.560744 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-0b782fb1-5794-42fc-b69c-c31ce96d17d5 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:37.695588 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-0b782fb1-5794-42fc-b69c-c31ce96d17d5 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:37.704056 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-0b782fb1-5794-42fc-b69c-c31ce96d17d5 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1264 microversion: 2.1 time: 0.157695 Aug 24 10:31:37.704629 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 562/1114] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:37 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:38.725967 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-697bd298-13a3-4b69-87f5-172af9e2fbe4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:38.726576 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-697bd298-13a3-4b69-87f5-172af9e2fbe4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:38.733794 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-697bd298-13a3-4b69-87f5-172af9e2fbe4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.734273 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-697bd298-13a3-4b69-87f5-172af9e2fbe4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.734699 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-697bd298-13a3-4b69-87f5-172af9e2fbe4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:38.735396 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-697bd298-13a3-4b69-87f5-172af9e2fbe4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:38.735839 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-697bd298-13a3-4b69-87f5-172af9e2fbe4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:38.736254 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-697bd298-13a3-4b69-87f5-172af9e2fbe4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:38.870555 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-697bd298-13a3-4b69-87f5-172af9e2fbe4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:38.878283 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-697bd298-13a3-4b69-87f5-172af9e2fbe4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1264 microversion: 2.1 time: 0.156130 Aug 24 10:31:38.878855 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 553/1115] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:38 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:39.898995 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-899b0757-0b91-4860-93d0-a57ac7d9d360 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:39.899623 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-899b0757-0b91-4860-93d0-a57ac7d9d360 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:39.906461 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-899b0757-0b91-4860-93d0-a57ac7d9d360 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:39.906938 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-899b0757-0b91-4860-93d0-a57ac7d9d360 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:39.907363 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-899b0757-0b91-4860-93d0-a57ac7d9d360 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:39.908125 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-899b0757-0b91-4860-93d0-a57ac7d9d360 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:39.908570 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-899b0757-0b91-4860-93d0-a57ac7d9d360 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:39.909019 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-899b0757-0b91-4860-93d0-a57ac7d9d360 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:40.044665 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-899b0757-0b91-4860-93d0-a57ac7d9d360 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:40.052803 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-899b0757-0b91-4860-93d0-a57ac7d9d360 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1264 microversion: 2.1 time: 0.157640 Aug 24 10:31:40.053475 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 563/1116] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:39 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:41.075508 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-da68e2d2-690d-439b-bfda-6bd3d8f5c11c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:41.076094 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-da68e2d2-690d-439b-bfda-6bd3d8f5c11c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:41.082737 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da68e2d2-690d-439b-bfda-6bd3d8f5c11c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:41.083215 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da68e2d2-690d-439b-bfda-6bd3d8f5c11c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:41.083644 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da68e2d2-690d-439b-bfda-6bd3d8f5c11c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:41.084334 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da68e2d2-690d-439b-bfda-6bd3d8f5c11c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:41.084781 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da68e2d2-690d-439b-bfda-6bd3d8f5c11c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:41.085356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-da68e2d2-690d-439b-bfda-6bd3d8f5c11c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:41.120588 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:41.142596 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=6 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:41.220447 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-da68e2d2-690d-439b-bfda-6bd3d8f5c11c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:41.229501 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-da68e2d2-690d-439b-bfda-6bd3d8f5c11c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1264 microversion: 2.1 time: 0.159163 Aug 24 10:31:41.230074 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 554/1117] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:41 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:42.250399 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-774d41b4-0fac-465f-81c2-93644f18dbf6 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:42.251041 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-774d41b4-0fac-465f-81c2-93644f18dbf6 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:42.253425 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:42.258180 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-774d41b4-0fac-465f-81c2-93644f18dbf6 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:42.258668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-774d41b4-0fac-465f-81c2-93644f18dbf6 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:42.259104 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-774d41b4-0fac-465f-81c2-93644f18dbf6 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:42.260418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-774d41b4-0fac-465f-81c2-93644f18dbf6 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:42.261157 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-774d41b4-0fac-465f-81c2-93644f18dbf6 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:42.261591 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-774d41b4-0fac-465f-81c2-93644f18dbf6 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:42.402699 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-774d41b4-0fac-465f-81c2-93644f18dbf6 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:42.410492 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-774d41b4-0fac-465f-81c2-93644f18dbf6 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1264 microversion: 2.1 time: 0.164046 Aug 24 10:31:42.411057 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 564/1118] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:42 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:43.433410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-934749fb-e5e2-4c24-bc3b-4bc68e64776f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:43.433410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-934749fb-e5e2-4c24-bc3b-4bc68e64776f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:43.437906 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-934749fb-e5e2-4c24-bc3b-4bc68e64776f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:43.438385 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-934749fb-e5e2-4c24-bc3b-4bc68e64776f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:43.438817 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-934749fb-e5e2-4c24-bc3b-4bc68e64776f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:43.439552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-934749fb-e5e2-4c24-bc3b-4bc68e64776f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:43.439993 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-934749fb-e5e2-4c24-bc3b-4bc68e64776f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:43.440414 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-934749fb-e5e2-4c24-bc3b-4bc68e64776f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:43.576138 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-934749fb-e5e2-4c24-bc3b-4bc68e64776f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:43.583847 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-934749fb-e5e2-4c24-bc3b-4bc68e64776f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1264 microversion: 2.1 time: 0.157305 Aug 24 10:31:43.584415 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 555/1119] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:43 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:44.606226 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-4094adf0-4db5-4829-aaeb-68d6b8fbb8bc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:44.606849 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-4094adf0-4db5-4829-aaeb-68d6b8fbb8bc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:44.613755 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4094adf0-4db5-4829-aaeb-68d6b8fbb8bc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:44.614283 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4094adf0-4db5-4829-aaeb-68d6b8fbb8bc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:44.614725 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4094adf0-4db5-4829-aaeb-68d6b8fbb8bc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:44.615434 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4094adf0-4db5-4829-aaeb-68d6b8fbb8bc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:44.615888 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4094adf0-4db5-4829-aaeb-68d6b8fbb8bc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:44.616314 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-4094adf0-4db5-4829-aaeb-68d6b8fbb8bc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:44.755534 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-4094adf0-4db5-4829-aaeb-68d6b8fbb8bc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:44.764001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-4094adf0-4db5-4829-aaeb-68d6b8fbb8bc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1264 microversion: 2.1 time: 0.162354 Aug 24 10:31:44.764571 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 565/1120] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:44 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:45.785674 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-8c7b1c9b-b976-44fe-951b-498619e78d0a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:45.786444 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-8c7b1c9b-b976-44fe-951b-498619e78d0a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:45.793439 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8c7b1c9b-b976-44fe-951b-498619e78d0a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:45.793933 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8c7b1c9b-b976-44fe-951b-498619e78d0a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:45.794372 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8c7b1c9b-b976-44fe-951b-498619e78d0a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:45.795231 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8c7b1c9b-b976-44fe-951b-498619e78d0a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:45.795530 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8c7b1c9b-b976-44fe-951b-498619e78d0a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:45.795953 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-8c7b1c9b-b976-44fe-951b-498619e78d0a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:45.944018 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-8c7b1c9b-b976-44fe-951b-498619e78d0a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:45.952175 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-8c7b1c9b-b976-44fe-951b-498619e78d0a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1264 microversion: 2.1 time: 0.170351 Aug 24 10:31:45.952763 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 556/1121] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:45 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:31:46.088238 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-ce0e0b0b-f858-427e-8e00-1bb1f787756f req-40d471ec-a695-4f15-8a85-54d1da811366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51ea99a-77b4-4634-81d9-9336811c57e8", "name": "network-vif-plugged", "status": "completed", "tag": "4521639c-8ab3-4078-b005-8055730c1867"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:46.098827 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-ce0e0b0b-f858-427e-8e00-1bb1f787756f req-40d471ec-a695-4f15-8a85-54d1da811366 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:46.099290 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-ce0e0b0b-f858-427e-8e00-1bb1f787756f req-40d471ec-a695-4f15-8a85-54d1da811366 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:46.099711 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-ce0e0b0b-f858-427e-8e00-1bb1f787756f req-40d471ec-a695-4f15-8a85-54d1da811366 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:46.112049 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-ce0e0b0b-f858-427e-8e00-1bb1f787756f req-40d471ec-a695-4f15-8a85-54d1da811366 service nova] Creating event network-vif-plugged:4521639c-8ab3-4078-b005-8055730c1867 for instance b51ea99a-77b4-4634-81d9-9336811c57e8 on hv-cinder-85427 Aug 24 10:31:46.117202 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-ce0e0b0b-f858-427e-8e00-1bb1f787756f req-40d471ec-a695-4f15-8a85-54d1da811366 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032984 Aug 24 10:31:46.117792 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 566/1122] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:31:46.972834 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-0639b0dd-c2c4-4fa9-b1fa-99e3da726f2c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:46.973481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-0639b0dd-c2c4-4fa9-b1fa-99e3da726f2c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:46.980180 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0639b0dd-c2c4-4fa9-b1fa-99e3da726f2c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:46.980640 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0639b0dd-c2c4-4fa9-b1fa-99e3da726f2c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:46.981108 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0639b0dd-c2c4-4fa9-b1fa-99e3da726f2c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:46.981851 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0639b0dd-c2c4-4fa9-b1fa-99e3da726f2c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:46.982309 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0639b0dd-c2c4-4fa9-b1fa-99e3da726f2c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:46.987043 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-0639b0dd-c2c4-4fa9-b1fa-99e3da726f2c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:47.129880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-0639b0dd-c2c4-4fa9-b1fa-99e3da726f2c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:47.138136 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-0639b0dd-c2c4-4fa9-b1fa-99e3da726f2c tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1264 microversion: 2.1 time: 0.169508 Aug 24 10:31:47.138712 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 557/1123] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:46 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:48.161334 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-64227831-5143-47db-944f-7c73d13b3779 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:48.162022 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-64227831-5143-47db-944f-7c73d13b3779 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:48.168919 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64227831-5143-47db-944f-7c73d13b3779 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:48.169408 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64227831-5143-47db-944f-7c73d13b3779 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:48.169845 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64227831-5143-47db-944f-7c73d13b3779 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:48.170551 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64227831-5143-47db-944f-7c73d13b3779 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:48.171016 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64227831-5143-47db-944f-7c73d13b3779 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:48.171448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-64227831-5143-47db-944f-7c73d13b3779 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:48.313577 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-64227831-5143-47db-944f-7c73d13b3779 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:48.321532 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-64227831-5143-47db-944f-7c73d13b3779 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1451 microversion: 2.1 time: 0.165013 Aug 24 10:31:48.322130 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 567/1124] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:48 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:48.341610 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3638f5e0-8fd0-47e8-96d6-8ec45d75149f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:31:48.342227 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3638f5e0-8fd0-47e8-96d6-8ec45d75149f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:31:48.349096 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3638f5e0-8fd0-47e8-96d6-8ec45d75149f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:48.349595 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3638f5e0-8fd0-47e8-96d6-8ec45d75149f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:48.350055 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3638f5e0-8fd0-47e8-96d6-8ec45d75149f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:48.351649 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3638f5e0-8fd0-47e8-96d6-8ec45d75149f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:48.351649 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3638f5e0-8fd0-47e8-96d6-8ec45d75149f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:48.351649 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3638f5e0-8fd0-47e8-96d6-8ec45d75149f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:48.490740 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3638f5e0-8fd0-47e8-96d6-8ec45d75149f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:31:48.498545 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3638f5e0-8fd0-47e8-96d6-8ec45d75149f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1451 microversion: 2.1 time: 0.160741 Aug 24 10:31:48.499113 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 558/1125] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:31:48 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:31:50.627772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-c3156216-f0b7-4ca2-88cd-470f3aeb4ddd req-d69ffaf7-2a6d-4d9a-92e2-f1cdbc7747b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51ea99a-77b4-4634-81d9-9336811c57e8", "tag": "4521639c-8ab3-4078-b005-8055730c1867"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:31:50.638456 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-c3156216-f0b7-4ca2-88cd-470f3aeb4ddd req-d69ffaf7-2a6d-4d9a-92e2-f1cdbc7747b3 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:31:50.638930 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-c3156216-f0b7-4ca2-88cd-470f3aeb4ddd req-d69ffaf7-2a6d-4d9a-92e2-f1cdbc7747b3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:31:50.639352 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-c3156216-f0b7-4ca2-88cd-470f3aeb4ddd req-d69ffaf7-2a6d-4d9a-92e2-f1cdbc7747b3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:31:50.650611 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-c3156216-f0b7-4ca2-88cd-470f3aeb4ddd req-d69ffaf7-2a6d-4d9a-92e2-f1cdbc7747b3 service nova] Creating event network-changed:4521639c-8ab3-4078-b005-8055730c1867 for instance b51ea99a-77b4-4634-81d9-9336811c57e8 on hv-cinder-85427 Aug 24 10:31:50.656128 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-c3156216-f0b7-4ca2-88cd-470f3aeb4ddd req-d69ffaf7-2a6d-4d9a-92e2-f1cdbc7747b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031976 Aug 24 10:31:50.656777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 568/1126] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:32:06.511479 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:32:06.512173 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Wed Aug 24 10:32:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:32:32.139828 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:32:32.140456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Wed Aug 24 10:32:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:33:31.885069 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:31.885860 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=74 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:31.889859 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1858910843", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-894496397", "security_groups": [{"name": "tempest-secgroup-smoke-428591116"}], "block_device_mapping_v2": [{"uuid": "03a06eff-eca3-4634-aab0-d0ebd10dc1cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b1a677a-6846-4fad-a355-51b4933f0eab"}]}} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:32.109554 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.network.neutron [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] validate_networks() for [('2b1a677a-6846-4fad-a355-51b4933f0eab', None, None, None, None, None)] {{(pid=121270) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:33:32.493250 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Flavor limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:33:32.493678 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Image limits 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:33:32.494152 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Flavor pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:33:32.494567 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Image pref 0:0:0 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:33:32.494966 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.virt.hardware [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:33:32.504291 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:32.504768 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:32.505238 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:32.506098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:32.506543 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:32.506959 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:32.523991 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Getting quotas for project 8013ed9ae5ed46b9bc656f193c43e118. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:33:32.527729 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.quota [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Getting quotas for user a71f15d0547a4d78b6d540e5eb5b2fbc and project 8013ed9ae5ed46b9bc656f193c43e118. Resources: {'instances', 'ram', 'cores'} {{(pid=121270) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:33:32.586456 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Going to run 1 instances... {{(pid=121270) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:33:32.588525 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03a06eff-eca3-4634-aab0-d0ebd10dc1cd',volume_size=None,volume_type=None)] {{(pid=121270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:33:33.204390 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-391b2a99-0d7f-466f-8ab1-cba1ae5e6e17 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.321048 Aug 24 10:33:33.205352 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 559/1127] 10.222.0.30 () {60 vars in 1147 bytes} [Wed Aug 24 10:33:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:33:33.215310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR oslo.messaging._drivers.impl_rabbit [-] [be65e45a-7d81-4d08-942f-54b6dc3f8363] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 10:33:33.216328 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:33.217855 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:33.225095 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-49385527-77f4-4779-b4c2-7460ba50f458 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:33.226366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-49385527-77f4-4779-b4c2-7460ba50f458 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:33.343428 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-49385527-77f4-4779-b4c2-7460ba50f458 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:33.351528 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-49385527-77f4-4779-b4c2-7460ba50f458 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1094 microversion: 2.1 time: 0.138473 Aug 24 10:33:33.352052 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 569/1128] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:33 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1094 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:34.372726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-93c56486-b891-4f4b-94ac-c8e514e76aa3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:34.373349 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-93c56486-b891-4f4b-94ac-c8e514e76aa3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:34.379753 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c56486-b891-4f4b-94ac-c8e514e76aa3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:34.380240 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c56486-b891-4f4b-94ac-c8e514e76aa3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:34.380674 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c56486-b891-4f4b-94ac-c8e514e76aa3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:34.381410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c56486-b891-4f4b-94ac-c8e514e76aa3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:34.381858 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c56486-b891-4f4b-94ac-c8e514e76aa3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:34.382280 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-93c56486-b891-4f4b-94ac-c8e514e76aa3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:34.447062 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-93c56486-b891-4f4b-94ac-c8e514e76aa3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:34.455244 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-93c56486-b891-4f4b-94ac-c8e514e76aa3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1144 microversion: 2.1 time: 0.086916 Aug 24 10:33:34.464356 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 560/1129] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:34 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:35.476101 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-ed0f80c4-38af-4cf8-99fd-f2dd7142fac8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:35.476724 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-ed0f80c4-38af-4cf8-99fd-f2dd7142fac8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:35.488172 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed0f80c4-38af-4cf8-99fd-f2dd7142fac8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:35.488660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed0f80c4-38af-4cf8-99fd-f2dd7142fac8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:35.489129 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed0f80c4-38af-4cf8-99fd-f2dd7142fac8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:35.489842 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed0f80c4-38af-4cf8-99fd-f2dd7142fac8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:35.490297 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed0f80c4-38af-4cf8-99fd-f2dd7142fac8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:35.490720 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-ed0f80c4-38af-4cf8-99fd-f2dd7142fac8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:35.506888 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] [be65e45a-7d81-4d08-942f-54b6dc3f8363] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 53242. Aug 24 10:33:35.556817 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-ed0f80c4-38af-4cf8-99fd-f2dd7142fac8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:35.565362 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-ed0f80c4-38af-4cf8-99fd-f2dd7142fac8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1200 microversion: 2.1 time: 0.093066 Aug 24 10:33:35.565941 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 570/1130] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:35 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:36.589671 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7e22e4bf-07ab-4841-9136-5177d634b65a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:36.590886 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7e22e4bf-07ab-4841-9136-5177d634b65a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:36.598956 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e22e4bf-07ab-4841-9136-5177d634b65a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:36.599651 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e22e4bf-07ab-4841-9136-5177d634b65a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:36.600269 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e22e4bf-07ab-4841-9136-5177d634b65a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:36.601016 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e22e4bf-07ab-4841-9136-5177d634b65a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:36.601472 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e22e4bf-07ab-4841-9136-5177d634b65a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:36.601902 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7e22e4bf-07ab-4841-9136-5177d634b65a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:36.841778 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7e22e4bf-07ab-4841-9136-5177d634b65a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:36.850791 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7e22e4bf-07ab-4841-9136-5177d634b65a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1277 microversion: 2.1 time: 0.265017 Aug 24 10:33:36.851726 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 561/1131] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:36 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1277 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:37.417825 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-791b2638-1c02-443c-aa0e-e401cd5ec329 req-824010e6-3485-4a6f-b705-7ea4457a3f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde4ad7d-c3b3-45cd-a875-a500bda2a358", "tag": "2d388cf0-ae9b-44b8-b61e-ae302166263a"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:37.427925 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-791b2638-1c02-443c-aa0e-e401cd5ec329 req-824010e6-3485-4a6f-b705-7ea4457a3f55 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:37.428397 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-791b2638-1c02-443c-aa0e-e401cd5ec329 req-824010e6-3485-4a6f-b705-7ea4457a3f55 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:37.428826 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-791b2638-1c02-443c-aa0e-e401cd5ec329 req-824010e6-3485-4a6f-b705-7ea4457a3f55 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:37.440487 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-791b2638-1c02-443c-aa0e-e401cd5ec329 req-824010e6-3485-4a6f-b705-7ea4457a3f55 service nova] Creating event network-changed:2d388cf0-ae9b-44b8-b61e-ae302166263a for instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 on hv-cinder-85427 Aug 24 10:33:37.445810 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-791b2638-1c02-443c-aa0e-e401cd5ec329 req-824010e6-3485-4a6f-b705-7ea4457a3f55 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093739 Aug 24 10:33:37.446433 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 571/1132] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:33:37.875112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-c6108875-37c6-4c2c-9caf-3efd1765c672 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:37.875757 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-c6108875-37c6-4c2c-9caf-3efd1765c672 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:37.882582 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c6108875-37c6-4c2c-9caf-3efd1765c672 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:37.883063 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c6108875-37c6-4c2c-9caf-3efd1765c672 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:37.883492 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c6108875-37c6-4c2c-9caf-3efd1765c672 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:37.884189 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c6108875-37c6-4c2c-9caf-3efd1765c672 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:37.884632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c6108875-37c6-4c2c-9caf-3efd1765c672 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:37.885081 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-c6108875-37c6-4c2c-9caf-3efd1765c672 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:38.096060 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-c6108875-37c6-4c2c-9caf-3efd1765c672 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:38.105382 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-c6108875-37c6-4c2c-9caf-3efd1765c672 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.234115 Aug 24 10:33:38.105959 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 562/1133] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:37 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:39.128285 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-448057ed-6e20-46a1-8c62-7f0a86fc26de tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:39.129014 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-448057ed-6e20-46a1-8c62-7f0a86fc26de tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:39.135636 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-448057ed-6e20-46a1-8c62-7f0a86fc26de tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:39.136119 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-448057ed-6e20-46a1-8c62-7f0a86fc26de tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:39.136554 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-448057ed-6e20-46a1-8c62-7f0a86fc26de tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:39.137289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-448057ed-6e20-46a1-8c62-7f0a86fc26de tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:39.137728 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-448057ed-6e20-46a1-8c62-7f0a86fc26de tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:39.138155 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-448057ed-6e20-46a1-8c62-7f0a86fc26de tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:39.272683 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-448057ed-6e20-46a1-8c62-7f0a86fc26de tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:39.280393 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-448057ed-6e20-46a1-8c62-7f0a86fc26de tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.157558 Aug 24 10:33:39.280977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 572/1134] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:39 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:40.302241 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-df44db11-06b2-445c-942d-a80abc8504c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:40.305446 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-df44db11-06b2-445c-942d-a80abc8504c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:40.309007 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df44db11-06b2-445c-942d-a80abc8504c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:40.309520 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df44db11-06b2-445c-942d-a80abc8504c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:40.309959 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df44db11-06b2-445c-942d-a80abc8504c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:40.310659 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df44db11-06b2-445c-942d-a80abc8504c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:40.311112 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df44db11-06b2-445c-942d-a80abc8504c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:40.311539 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-df44db11-06b2-445c-942d-a80abc8504c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:40.444040 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-df44db11-06b2-445c-942d-a80abc8504c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:40.453079 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-df44db11-06b2-445c-942d-a80abc8504c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.155286 Aug 24 10:33:40.453657 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 563/1135] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:40 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:41.473662 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-906a4bb0-c66d-4912-b0ff-11162a0cc123 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:41.474253 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-906a4bb0-c66d-4912-b0ff-11162a0cc123 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:41.480643 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-906a4bb0-c66d-4912-b0ff-11162a0cc123 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:41.481147 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-906a4bb0-c66d-4912-b0ff-11162a0cc123 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:41.481575 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-906a4bb0-c66d-4912-b0ff-11162a0cc123 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:41.482332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-906a4bb0-c66d-4912-b0ff-11162a0cc123 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:41.482783 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-906a4bb0-c66d-4912-b0ff-11162a0cc123 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:41.483197 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-906a4bb0-c66d-4912-b0ff-11162a0cc123 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:41.859574 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-906a4bb0-c66d-4912-b0ff-11162a0cc123 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:41.867966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-906a4bb0-c66d-4912-b0ff-11162a0cc123 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.398157 Aug 24 10:33:41.868538 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 573/1136] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:41 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:42.889322 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-286a9425-04f5-4036-9a1f-0d6471c8539e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:42.889961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-286a9425-04f5-4036-9a1f-0d6471c8539e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:42.892331 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=2 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:42.893613 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell0:SELECT=6 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:42.898314 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-286a9425-04f5-4036-9a1f-0d6471c8539e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:42.898800 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-286a9425-04f5-4036-9a1f-0d6471c8539e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:42.899239 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-286a9425-04f5-4036-9a1f-0d6471c8539e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:42.899931 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-286a9425-04f5-4036-9a1f-0d6471c8539e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:42.900386 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-286a9425-04f5-4036-9a1f-0d6471c8539e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:42.900817 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-286a9425-04f5-4036-9a1f-0d6471c8539e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:43.032752 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-286a9425-04f5-4036-9a1f-0d6471c8539e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:43.041327 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-286a9425-04f5-4036-9a1f-0d6471c8539e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.155858 Aug 24 10:33:43.041902 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 564/1137] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:42 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:33:44.062527 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-b556fec9-16aa-4433-8c14-fb08a06d321e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:44.063076 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-b556fec9-16aa-4433-8c14-fb08a06d321e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:44.066420 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell0:SELECT=2 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:44.071232 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b556fec9-16aa-4433-8c14-fb08a06d321e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:44.071760 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b556fec9-16aa-4433-8c14-fb08a06d321e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:44.072196 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b556fec9-16aa-4433-8c14-fb08a06d321e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:44.072966 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b556fec9-16aa-4433-8c14-fb08a06d321e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:44.073422 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b556fec9-16aa-4433-8c14-fb08a06d321e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:44.073847 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-b556fec9-16aa-4433-8c14-fb08a06d321e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:44.207101 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-b556fec9-16aa-4433-8c14-fb08a06d321e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:44.214728 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-b556fec9-16aa-4433-8c14-fb08a06d321e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.156198 Aug 24 10:33:44.218960 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 574/1138] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:44 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:45.235155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-39178398-4d71-4ddb-a99f-6197aba0b5c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:45.235850 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-39178398-4d71-4ddb-a99f-6197aba0b5c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:45.242533 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39178398-4d71-4ddb-a99f-6197aba0b5c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:45.242957 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39178398-4d71-4ddb-a99f-6197aba0b5c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:45.243392 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39178398-4d71-4ddb-a99f-6197aba0b5c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:45.244114 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39178398-4d71-4ddb-a99f-6197aba0b5c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:45.244564 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39178398-4d71-4ddb-a99f-6197aba0b5c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:45.245014 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-39178398-4d71-4ddb-a99f-6197aba0b5c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:45.383987 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-39178398-4d71-4ddb-a99f-6197aba0b5c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:45.391720 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-39178398-4d71-4ddb-a99f-6197aba0b5c8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.160519 Aug 24 10:33:45.392292 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 565/1139] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:45 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:46.413535 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-870306b3-eb27-4e6d-b006-7b1f478f0ffc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:46.414151 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-870306b3-eb27-4e6d-b006-7b1f478f0ffc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:46.420597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-870306b3-eb27-4e6d-b006-7b1f478f0ffc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:46.421117 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-870306b3-eb27-4e6d-b006-7b1f478f0ffc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:46.421547 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-870306b3-eb27-4e6d-b006-7b1f478f0ffc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:46.422247 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-870306b3-eb27-4e6d-b006-7b1f478f0ffc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:46.422702 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-870306b3-eb27-4e6d-b006-7b1f478f0ffc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:46.423533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-870306b3-eb27-4e6d-b006-7b1f478f0ffc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:46.562568 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-870306b3-eb27-4e6d-b006-7b1f478f0ffc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:46.572377 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-870306b3-eb27-4e6d-b006-7b1f478f0ffc tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.163541 Aug 24 10:33:46.573211 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 575/1140] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:46 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:47.594026 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7c7c5c31-5b30-441f-8343-90b049f092eb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:47.594580 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7c7c5c31-5b30-441f-8343-90b049f092eb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:47.601090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7c5c31-5b30-441f-8343-90b049f092eb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:47.601567 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7c5c31-5b30-441f-8343-90b049f092eb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:47.601998 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7c5c31-5b30-441f-8343-90b049f092eb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:47.602687 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7c5c31-5b30-441f-8343-90b049f092eb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:47.603137 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7c5c31-5b30-441f-8343-90b049f092eb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:47.603552 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7c7c5c31-5b30-441f-8343-90b049f092eb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:47.738819 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7c7c5c31-5b30-441f-8343-90b049f092eb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:47.746646 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7c7c5c31-5b30-441f-8343-90b049f092eb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.156846 Aug 24 10:33:47.747213 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 566/1141] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:47 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:48.155701 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:33:48.155986 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Wed Aug 24 10:33:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:33:48.566150 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-d1dc287f-d146-4087-81a2-03511b34417a req-254dc40b-e809-4861-ace5-fe9e5d9a92b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde4ad7d-c3b3-45cd-a875-a500bda2a358", "name": "network-vif-plugged", "status": "completed", "tag": "2d388cf0-ae9b-44b8-b61e-ae302166263a"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:48.576601 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d1dc287f-d146-4087-81a2-03511b34417a req-254dc40b-e809-4861-ace5-fe9e5d9a92b3 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:48.577137 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d1dc287f-d146-4087-81a2-03511b34417a req-254dc40b-e809-4861-ace5-fe9e5d9a92b3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:48.577579 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-d1dc287f-d146-4087-81a2-03511b34417a req-254dc40b-e809-4861-ace5-fe9e5d9a92b3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:48.589359 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-d1dc287f-d146-4087-81a2-03511b34417a req-254dc40b-e809-4861-ace5-fe9e5d9a92b3 service nova] Creating event network-vif-plugged:2d388cf0-ae9b-44b8-b61e-ae302166263a for instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 on hv-cinder-85427 Aug 24 10:33:48.594784 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-d1dc287f-d146-4087-81a2-03511b34417a req-254dc40b-e809-4861-ace5-fe9e5d9a92b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032371 Aug 24 10:33:48.595499 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 576/1142] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:33:48.768194 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-3d45bbca-f4f3-44d3-b5ac-87ec2d3b972f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:48.768798 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-3d45bbca-f4f3-44d3-b5ac-87ec2d3b972f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:48.775565 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3d45bbca-f4f3-44d3-b5ac-87ec2d3b972f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:48.776037 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3d45bbca-f4f3-44d3-b5ac-87ec2d3b972f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:48.776463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3d45bbca-f4f3-44d3-b5ac-87ec2d3b972f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:48.777261 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3d45bbca-f4f3-44d3-b5ac-87ec2d3b972f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:48.777631 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3d45bbca-f4f3-44d3-b5ac-87ec2d3b972f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:48.778045 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-3d45bbca-f4f3-44d3-b5ac-87ec2d3b972f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:48.918632 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-3d45bbca-f4f3-44d3-b5ac-87ec2d3b972f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:48.926728 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-3d45bbca-f4f3-44d3-b5ac-87ec2d3b972f tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.162987 Aug 24 10:33:48.927296 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 567/1143] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:48 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:49.948673 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-a10581b0-55dc-488d-8c46-bfa02f308ca8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:49.949459 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-a10581b0-55dc-488d-8c46-bfa02f308ca8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:49.956357 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a10581b0-55dc-488d-8c46-bfa02f308ca8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:49.956836 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a10581b0-55dc-488d-8c46-bfa02f308ca8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:49.957298 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a10581b0-55dc-488d-8c46-bfa02f308ca8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:49.957990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a10581b0-55dc-488d-8c46-bfa02f308ca8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:49.958442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a10581b0-55dc-488d-8c46-bfa02f308ca8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:49.958867 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-a10581b0-55dc-488d-8c46-bfa02f308ca8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:50.094668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-a10581b0-55dc-488d-8c46-bfa02f308ca8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:50.103118 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-a10581b0-55dc-488d-8c46-bfa02f308ca8 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1265 microversion: 2.1 time: 0.158710 Aug 24 10:33:50.103689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 577/1144] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:49 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:51.172821 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-1476e847-a97c-4c56-a4df-8987ba6f2a59 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:51.173572 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-1476e847-a97c-4c56-a4df-8987ba6f2a59 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:51.180027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1476e847-a97c-4c56-a4df-8987ba6f2a59 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:51.180501 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1476e847-a97c-4c56-a4df-8987ba6f2a59 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:51.180965 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1476e847-a97c-4c56-a4df-8987ba6f2a59 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:51.181659 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1476e847-a97c-4c56-a4df-8987ba6f2a59 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:51.182106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1476e847-a97c-4c56-a4df-8987ba6f2a59 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:51.182535 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-1476e847-a97c-4c56-a4df-8987ba6f2a59 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:51.291886 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:33:51.292415 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Wed Aug 24 10:33:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:33:51.319305 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-1476e847-a97c-4c56-a4df-8987ba6f2a59 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:51.327196 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-1476e847-a97c-4c56-a4df-8987ba6f2a59 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1453 microversion: 2.1 time: 0.207182 Aug 24 10:33:51.327759 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 568/1145] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:51 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:51.348216 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-af4eacf5-add5-498c-a8ef-1111bf2f0c1b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:33:51.348839 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-af4eacf5-add5-498c-a8ef-1111bf2f0c1b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:33:51.355269 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-af4eacf5-add5-498c-a8ef-1111bf2f0c1b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:51.355753 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-af4eacf5-add5-498c-a8ef-1111bf2f0c1b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:51.356191 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-af4eacf5-add5-498c-a8ef-1111bf2f0c1b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:51.356905 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-af4eacf5-add5-498c-a8ef-1111bf2f0c1b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:51.357366 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-af4eacf5-add5-498c-a8ef-1111bf2f0c1b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:51.357791 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-af4eacf5-add5-498c-a8ef-1111bf2f0c1b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:51.494001 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-af4eacf5-add5-498c-a8ef-1111bf2f0c1b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:33:51.501786 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-af4eacf5-add5-498c-a8ef-1111bf2f0c1b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1453 microversion: 2.1 time: 0.157965 Aug 24 10:33:51.502466 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 578/1146] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:33:51 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:33:53.534446 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-5f51431d-a50f-49dc-bf59-a8a92d33c4b8 req-1b7d5370-b737-4a81-ab83-db50a9447d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde4ad7d-c3b3-45cd-a875-a500bda2a358", "tag": "2d388cf0-ae9b-44b8-b61e-ae302166263a"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:33:53.544586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-5f51431d-a50f-49dc-bf59-a8a92d33c4b8 req-1b7d5370-b737-4a81-ab83-db50a9447d86 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:33:53.545090 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-5f51431d-a50f-49dc-bf59-a8a92d33c4b8 req-1b7d5370-b737-4a81-ab83-db50a9447d86 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:33:53.545522 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-5f51431d-a50f-49dc-bf59-a8a92d33c4b8 req-1b7d5370-b737-4a81-ab83-db50a9447d86 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:33:53.560963 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-5f51431d-a50f-49dc-bf59-a8a92d33c4b8 req-1b7d5370-b737-4a81-ab83-db50a9447d86 service nova] Creating event network-changed:2d388cf0-ae9b-44b8-b61e-ae302166263a for instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 on hv-cinder-85427 Aug 24 10:33:53.567733 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-5f51431d-a50f-49dc-bf59-a8a92d33c4b8 req-1b7d5370-b737-4a81-ab83-db50a9447d86 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092941 Aug 24 10:33:53.568366 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 569/1147] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:35:21.423793 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_api:SELECT=22 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:21.425054 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG dbcounter [-] [121271] Writing DB stats nova_cell1:SELECT=46 {{(pid=121271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:21.426410 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:21.427215 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG dbcounter [-] [121270] Writing DB stats nova_cell1:SELECT=58 {{(pid=121270) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:21.430678 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9e2fbeaa-4e02-480c-b361-932971111fcb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:21.433957 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9e2fbeaa-4e02-480c-b361-932971111fcb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:21.434092 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-31f9de03-fa62-4650-9287-611d91de2294 req-bf12d98a-1ae9-4f28-9f06-4416686ee09e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde4ad7d-c3b3-45cd-a875-a500bda2a358", "tag": "2d388cf0-ae9b-44b8-b61e-ae302166263a"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:21.437137 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9e2fbeaa-4e02-480c-b361-932971111fcb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:21.437629 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9e2fbeaa-4e02-480c-b361-932971111fcb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:21.438102 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9e2fbeaa-4e02-480c-b361-932971111fcb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:21.438818 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9e2fbeaa-4e02-480c-b361-932971111fcb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:21.439270 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9e2fbeaa-4e02-480c-b361-932971111fcb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:21.439697 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9e2fbeaa-4e02-480c-b361-932971111fcb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:21.441680 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-31f9de03-fa62-4650-9287-611d91de2294 req-bf12d98a-1ae9-4f28-9f06-4416686ee09e service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:21.442203 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-31f9de03-fa62-4650-9287-611d91de2294 req-bf12d98a-1ae9-4f28-9f06-4416686ee09e service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:21.442864 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-31f9de03-fa62-4650-9287-611d91de2294 req-bf12d98a-1ae9-4f28-9f06-4416686ee09e service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:21.454418 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-31f9de03-fa62-4650-9287-611d91de2294 req-bf12d98a-1ae9-4f28-9f06-4416686ee09e service nova] Creating event network-changed:2d388cf0-ae9b-44b8-b61e-ae302166263a for instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 on hv-cinder-85427 Aug 24 10:35:21.459875 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-31f9de03-fa62-4650-9287-611d91de2294 req-bf12d98a-1ae9-4f28-9f06-4416686ee09e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035860 Aug 24 10:35:21.460474 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 570/1148] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:35:21.468305 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9e2fbeaa-4e02-480c-b361-932971111fcb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Going to try to terminate instance {{(pid=121271) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:35:21.740278 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9e2fbeaa-4e02-480c-b361-932971111fcb tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 204 len: 0 microversion: 2.1 time: 0.318432 Aug 24 10:35:21.741078 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 579/1149] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:35:21 2022] DELETE /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:35:21.749794 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-b7036640-4b36-417c-b770-97848f81b7c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:21.750730 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-b7036640-4b36-417c-b770-97848f81b7c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:21.757106 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7036640-4b36-417c-b770-97848f81b7c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:21.757888 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7036640-4b36-417c-b770-97848f81b7c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:21.758793 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7036640-4b36-417c-b770-97848f81b7c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:21.759925 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7036640-4b36-417c-b770-97848f81b7c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:21.760401 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7036640-4b36-417c-b770-97848f81b7c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:21.760830 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-b7036640-4b36-417c-b770-97848f81b7c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:21.907796 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-b7036640-4b36-417c-b770-97848f81b7c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:21.916457 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-b7036640-4b36-417c-b770-97848f81b7c4 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1577 microversion: 2.1 time: 0.170712 Aug 24 10:35:21.917163 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 571/1150] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:21 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:22.938983 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-68072fff-6e14-4bfb-87da-58d597c7436e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:22.939689 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-68072fff-6e14-4bfb-87da-58d597c7436e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:22.946169 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68072fff-6e14-4bfb-87da-58d597c7436e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:22.946657 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68072fff-6e14-4bfb-87da-58d597c7436e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:22.947095 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68072fff-6e14-4bfb-87da-58d597c7436e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:22.947797 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68072fff-6e14-4bfb-87da-58d597c7436e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:22.948252 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68072fff-6e14-4bfb-87da-58d597c7436e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:22.948679 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-68072fff-6e14-4bfb-87da-58d597c7436e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:23.087531 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-68072fff-6e14-4bfb-87da-58d597c7436e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:23.096333 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-68072fff-6e14-4bfb-87da-58d597c7436e tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1577 microversion: 2.1 time: 0.161955 Aug 24 10:35:23.105568 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 580/1151] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:22 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:24.105195 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [req-312b9b5e-8e87-432f-837c-0a589d1c0c77 req-c726d7ef-db02-43d6-ad85-8e62b884dba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde4ad7d-c3b3-45cd-a875-a500bda2a358", "name": "network-vif-deleted", "tag": "2d388cf0-ae9b-44b8-b61e-ae302166263a"}]} {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:24.115697 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-312b9b5e-8e87-432f-837c-0a589d1c0c77 req-c726d7ef-db02-43d6-ad85-8e62b884dba3 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.116337 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-312b9b5e-8e87-432f-837c-0a589d1c0c77 req-c726d7ef-db02-43d6-ad85-8e62b884dba3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.116687 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [req-312b9b5e-8e87-432f-837c-0a589d1c0c77 req-c726d7ef-db02-43d6-ad85-8e62b884dba3 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.117501 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-d86b76a7-e136-431d-b86f-72174de75626 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:24.118128 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-d86b76a7-e136-431d-b86f-72174de75626 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:24.124573 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d86b76a7-e136-431d-b86f-72174de75626 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.125134 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d86b76a7-e136-431d-b86f-72174de75626 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.126233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d86b76a7-e136-431d-b86f-72174de75626 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.126940 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d86b76a7-e136-431d-b86f-72174de75626 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:24.127402 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d86b76a7-e136-431d-b86f-72174de75626 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:24.127832 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-d86b76a7-e136-431d-b86f-72174de75626 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:24.128705 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.compute.server_external_events [req-312b9b5e-8e87-432f-837c-0a589d1c0c77 req-c726d7ef-db02-43d6-ad85-8e62b884dba3 service nova] Creating event network-vif-deleted:2d388cf0-ae9b-44b8-b61e-ae302166263a for instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 on hv-cinder-85427 Aug 24 10:35:24.133907 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [req-312b9b5e-8e87-432f-837c-0a589d1c0c77 req-c726d7ef-db02-43d6-ad85-8e62b884dba3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032490 Aug 24 10:35:24.134553 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 572/1152] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:24.191482 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-d86b76a7-e136-431d-b86f-72174de75626 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:24.199474 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-d86b76a7-e136-431d-b86f-72174de75626 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1392 microversion: 2.1 time: 0.086095 Aug 24 10:35:24.200047 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 581/1153] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:24 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1392 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:35:25.220897 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:25.221613 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:25.227777 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:25.228260 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:25.228694 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:25.229423 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:25.229880 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:25.230303 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:25.261850 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:25.262330 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:25.263217 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:25.263682 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.objects.instance [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lazy-loading 'fault' on Instance uuid fde4ad7d-c3b3-45cd-a875-a500bda2a358 {{(pid=121270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:35:25.309196 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:25.318167 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-2f30882a-d95b-42c3-9709-cfd54d8258b3 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 200 len: 1230 microversion: 2.1 time: 0.101960 Aug 24 10:35:25.318758 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 573/1154] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:25 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:26.340640 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:26.341298 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: fde4ad7d-c3b3-45cd-a875-a500bda2a358] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:26.348429 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:26.348939 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:26.349381 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:26.350073 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:26.350530 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:26.350958 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:26.364277 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] HTTP exception thrown: Instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 could not be found. Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Request method failure captured: Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 HTTP/1.1 Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBf1bstjXJc1Ndk0FtZNI0N0MKVbFdRfgYT511MNAX2pW4qzAlQgo2omaW54zNgMI-cTpa6NNvQWP3-o4TTF_iNSnWWu7blOTAfUOf_djzc-PJCnrLwxMEi1hB81bTk5OzQFx_fM-R6f70w0498gcp0D_AIpT06zWdm-EDzjjPjt8KqU Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8013ed9ae5ed46b9bc656f193c43e118 Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:35:26.365924 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8013ed9ae5ed46b9bc656f193c43e118", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8013ed9ae5ed46b9bc656f193c43e118 Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-TestVolumeBootPattern-1998904815-project Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: a71f15d0547a4d78b6d540e5eb5b2fbc Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-TestVolumeBootPattern-1998904815-project Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 could not be found. Aug 24 10:35:26.367777 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': 'fde4ad7d-c3b3-45cd-a875-a500bda2a358'} Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 could not be found. Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:26.368990 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 could not be found. Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 could not be found. Aug 24 10:35:26.370800 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:26.372443 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Returning 404 to user: Instance fde4ad7d-c3b3-45cd-a875-a500bda2a358 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:26.372443 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-336ad769-6803-45d1-9b89-a35d9913094a tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358" status: 404 len: 111 microversion: 2.1 time: 0.030812 Aug 24 10:35:26.372443 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 582/1155] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:26 2022] GET /compute/v2.1/servers/fde4ad7d-c3b3-45cd-a875-a500bda2a358 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:26.519716 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:35:26.520028 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Wed Aug 24 10:35:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:35:29.750835 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-92d1580a-952f-4ca4-bc41-58aefc9efc27 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:29.751463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-92d1580a-952f-4ca4-bc41-58aefc9efc27 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:29.752042 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-fc77e94a-afd0-4c1c-b173-6103146148b0 req-a81bac46-91ea-4450-b640-a4e94a4dadd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51ea99a-77b4-4634-81d9-9336811c57e8", "tag": "4521639c-8ab3-4078-b005-8055730c1867"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:29.759360 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d1580a-952f-4ca4-bc41-58aefc9efc27 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:29.759960 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d1580a-952f-4ca4-bc41-58aefc9efc27 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:29.760462 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d1580a-952f-4ca4-bc41-58aefc9efc27 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:29.761287 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d1580a-952f-4ca4-bc41-58aefc9efc27 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:29.761968 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d1580a-952f-4ca4-bc41-58aefc9efc27 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:29.762463 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-92d1580a-952f-4ca4-bc41-58aefc9efc27 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:29.762977 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fc77e94a-afd0-4c1c-b173-6103146148b0 req-a81bac46-91ea-4450-b640-a4e94a4dadd4 service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:29.763456 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fc77e94a-afd0-4c1c-b173-6103146148b0 req-a81bac46-91ea-4450-b640-a4e94a4dadd4 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:29.763890 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-fc77e94a-afd0-4c1c-b173-6103146148b0 req-a81bac46-91ea-4450-b640-a4e94a4dadd4 service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:29.775391 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-fc77e94a-afd0-4c1c-b173-6103146148b0 req-a81bac46-91ea-4450-b640-a4e94a4dadd4 service nova] Creating event network-changed:4521639c-8ab3-4078-b005-8055730c1867 for instance b51ea99a-77b4-4634-81d9-9336811c57e8 on hv-cinder-85427 Aug 24 10:35:29.781479 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-fc77e94a-afd0-4c1c-b173-6103146148b0 req-a81bac46-91ea-4450-b640-a4e94a4dadd4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033134 Aug 24 10:35:29.785961 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 583/1156] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:35:29.792811 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-92d1580a-952f-4ca4-bc41-58aefc9efc27 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Going to try to terminate instance {{(pid=121270) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:35:30.191241 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-92d1580a-952f-4ca4-bc41-58aefc9efc27 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 204 len: 0 microversion: 2.1 time: 0.444804 Aug 24 10:35:30.192098 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 574/1157] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:35:29 2022] DELETE /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:35:30.200999 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-99f511a2-4f7c-4a76-b5c6-59784cc36c1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:30.202042 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-99f511a2-4f7c-4a76-b5c6-59784cc36c1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:30.209043 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-99f511a2-4f7c-4a76-b5c6-59784cc36c1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:30.209533 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-99f511a2-4f7c-4a76-b5c6-59784cc36c1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:30.210207 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-99f511a2-4f7c-4a76-b5c6-59784cc36c1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:30.210927 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-99f511a2-4f7c-4a76-b5c6-59784cc36c1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:30.211384 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-99f511a2-4f7c-4a76-b5c6-59784cc36c1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:30.211836 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-99f511a2-4f7c-4a76-b5c6-59784cc36c1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:30.348261 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.policy [None req-99f511a2-4f7c-4a76-b5c6-59784cc36c1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:30.356332 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-99f511a2-4f7c-4a76-b5c6-59784cc36c1d tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1575 microversion: 2.1 time: 0.159655 Aug 24 10:35:30.356922 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 584/1158] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:30 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:31.378570 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-7d58d749-b58b-4997-9f7a-44d921f70b22 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:31.379481 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-7d58d749-b58b-4997-9f7a-44d921f70b22 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:31.386235 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d58d749-b58b-4997-9f7a-44d921f70b22 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:31.386770 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d58d749-b58b-4997-9f7a-44d921f70b22 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:31.387203 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d58d749-b58b-4997-9f7a-44d921f70b22 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:31.387905 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d58d749-b58b-4997-9f7a-44d921f70b22 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:31.388355 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d58d749-b58b-4997-9f7a-44d921f70b22 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:31.388768 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-7d58d749-b58b-4997-9f7a-44d921f70b22 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:31.848464 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-7d58d749-b58b-4997-9f7a-44d921f70b22 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:31.857267 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-7d58d749-b58b-4997-9f7a-44d921f70b22 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1575 microversion: 2.1 time: 0.483339 Aug 24 10:35:31.857911 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 575/1159] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:31 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1575 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:32.511036 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [req-973fbe59-05f1-40e9-814b-0512d1965868 req-409976d0-9dd4-4043-a9c4-eb7bfa0739cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51ea99a-77b4-4634-81d9-9336811c57e8", "name": "network-vif-deleted", "tag": "4521639c-8ab3-4078-b005-8055730c1867"}]} {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:35:32.522031 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-973fbe59-05f1-40e9-814b-0512d1965868 req-409976d0-9dd4-4043-a9c4-eb7bfa0739cc service nova] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:32.522500 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-973fbe59-05f1-40e9-814b-0512d1965868 req-409976d0-9dd4-4043-a9c4-eb7bfa0739cc service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:32.522934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [req-973fbe59-05f1-40e9-814b-0512d1965868 req-409976d0-9dd4-4043-a9c4-eb7bfa0739cc service nova] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:32.534291 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.compute.server_external_events [req-973fbe59-05f1-40e9-814b-0512d1965868 req-409976d0-9dd4-4043-a9c4-eb7bfa0739cc service nova] Creating event network-vif-deleted:4521639c-8ab3-4078-b005-8055730c1867 for instance b51ea99a-77b4-4634-81d9-9336811c57e8 on hv-cinder-85427 Aug 24 10:35:32.540081 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [req-973fbe59-05f1-40e9-814b-0512d1965868 req-409976d0-9dd4-4043-a9c4-eb7bfa0739cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032832 Aug 24 10:35:32.540668 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 585/1160] 10.222.0.30 () {64 vars in 1317 bytes} [Wed Aug 24 10:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:35:32.884402 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-dd322d7f-d385-473d-b759-ddf2612849cd tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:32.885038 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-dd322d7f-d385-473d-b759-ddf2612849cd tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:32.891670 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd322d7f-d385-473d-b759-ddf2612849cd tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:32.892155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd322d7f-d385-473d-b759-ddf2612849cd tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:32.892586 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd322d7f-d385-473d-b759-ddf2612849cd tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:32.893319 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd322d7f-d385-473d-b759-ddf2612849cd tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:32.893767 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd322d7f-d385-473d-b759-ddf2612849cd tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:32.894250 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-dd322d7f-d385-473d-b759-ddf2612849cd tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:32.963000 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.policy [None req-dd322d7f-d385-473d-b759-ddf2612849cd tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71f15d0547a4d78b6d540e5eb5b2fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8013ed9ae5ed46b9bc656f193c43e118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:35:32.973182 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-dd322d7f-d385-473d-b759-ddf2612849cd tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 200 len: 1224 microversion: 2.1 time: 0.090338 Aug 24 10:35:32.973182 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 576/1161] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:32 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:35:33.993168 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:33.993782 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: b51ea99a-77b4-4634-81d9-9336811c57e8] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:33.999846 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.000315 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.000739 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.001442 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.001889 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.002306 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.015326 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] HTTP exception thrown: Instance b51ea99a-77b4-4634-81d9-9336811c57e8 could not be found. Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Request method failure captured: Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 HTTP/1.1 Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBf1bstjXJc1Ndk0FtZNI0N0MKVbFdRfgYT511MNAX2pW4qzAlQgo2omaW54zNgMI-cTpa6NNvQWP3-o4TTF_iNSnWWu7blOTAfUOf_djzc-PJCnrLwxMEi1hB81bTk5OzQFx_fM-R6f70w0498gcp0D_AIpT06zWdm-EDzjjPjt8KqU Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8013ed9ae5ed46b9bc656f193c43e118 Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:35:34.016934 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8013ed9ae5ed46b9bc656f193c43e118", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8013ed9ae5ed46b9bc656f193c43e118 Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-TestVolumeBootPattern-1998904815-project Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: a71f15d0547a4d78b6d540e5eb5b2fbc Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-TestVolumeBootPattern-1998904815-project Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance b51ea99a-77b4-4634-81d9-9336811c57e8 could not be found. Aug 24 10:35:34.018666 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': 'b51ea99a-77b4-4634-81d9-9336811c57e8'} Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51ea99a-77b4-4634-81d9-9336811c57e8 could not be found. Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:34.020448 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51ea99a-77b4-4634-81d9-9336811c57e8 could not be found. Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51ea99a-77b4-4634-81d9-9336811c57e8 could not be found. Aug 24 10:35:34.022200 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.023763 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Returning 404 to user: Instance b51ea99a-77b4-4634-81d9-9336811c57e8 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:34.023763 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-8b1d4be4-8ea8-4d7f-90b8-b4602e2ef8d7 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8" status: 404 len: 111 microversion: 2.1 time: 0.030032 Aug 24 10:35:34.023763 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 586/1162] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:33 2022] GET /compute/v2.1/servers/b51ea99a-77b4-4634-81d9-9336811c57e8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:34.523695 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:34.524252 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.compute.api [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121270) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:34.530653 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.533945 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.533945 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.533945 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.533945 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.534344 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG oslo_concurrency.lockutils [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.546294 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.wsgi [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] HTTP exception thrown: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Request method failure captured: Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: request: DELETE /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 HTTP/1.1 Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept: application/json Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Accept-Encoding: identity Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Connection: close Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Length: 0 Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Content-Type: application/json Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Host: 10.222.0.30 Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Openstack-System-Scope: None Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Auth-Token: gAAAAABjBf1bstjXJc1Ndk0FtZNI0N0MKVbFdRfgYT511MNAX2pW4qzAlQgo2omaW54zNgMI-cTpa6NNvQWP3-o4TTF_iNSnWWu7blOTAfUOf_djzc-PJCnrLwxMEi1hB81bTk5OzQFx_fM-R6f70w0498gcp0D_AIpT06zWdm-EDzjjPjt8KqU Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Id: None Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Domain-Name: None Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Identity-Status: Confirmed Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Is-Admin-Project: True Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Id: default Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Domain-Name: Default Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Id: 8013ed9ae5ed46b9bc656f193c43e118 Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Project-Name: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Role: reader,member Aug 24 10:35:34.548027 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Roles: reader,member Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8013ed9ae5ed46b9bc656f193c43e118", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Id: 8013ed9ae5ed46b9bc656f193c43e118 Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-Tenant-Name: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User: tempest-TestVolumeBootPattern-1998904815-project Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Id: default Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Domain-Name: Default Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Id: a71f15d0547a4d78b6d540e5eb5b2fbc Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: X-User-Name: tempest-TestVolumeBootPattern-1998904815-project Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: method: > Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: exception: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:35:34.550066 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: action_args: {'id': '35a33e3c-4ed3-4aa3-9a74-0188df168459'} Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:34.551358 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:35:34.553338 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.555320 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Returning 404 to user: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. {{(pid=121270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:34.555320 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-af480818-9a41-4738-8d32-669d20ed694b tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "DELETE /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 404 len: 111 microversion: 2.1 time: 0.030322 Aug 24 10:35:34.555320 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 577/1163] 10.222.0.30 () {58 vars in 1239 bytes} [Wed Aug 24 10:35:34 2022] DELETE /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:34.558339 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '>' {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:34.562706 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.compute.api [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] [instance: 35a33e3c-4ed3-4aa3-9a74-0188df168459] Fetching instance by UUID {{(pid=121271) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:35:34.564772 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.565289 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.565714 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.567047 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Acquiring lock "21af12e8-eed5-417b-a9f1-00673b481ea2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:35:34.567494 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:35:34.567909 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG oslo_concurrency.lockutils [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Lock "21af12e8-eed5-417b-a9f1-00673b481ea2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:35:34.583839 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.wsgi [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] HTTP exception thrown: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Request method failure captured: Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: request: GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 HTTP/1.1 Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept: application/json Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Accept-Encoding: identity Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Connection: close Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Length: 0 Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Content-Type: application/json Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Host: 10.222.0.30 Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Openstack-System-Scope: None Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: User-Agent: python-urllib3/1.26.11 Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Auth-Token: gAAAAABjBf1bstjXJc1Ndk0FtZNI0N0MKVbFdRfgYT511MNAX2pW4qzAlQgo2omaW54zNgMI-cTpa6NNvQWP3-o4TTF_iNSnWWu7blOTAfUOf_djzc-PJCnrLwxMEi1hB81bTk5OzQFx_fM-R6f70w0498gcp0D_AIpT06zWdm-EDzjjPjt8KqU Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Id: None Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Domain-Name: None Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Identity-Status: Confirmed Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Is-Admin-Project: True Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Id: default Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Domain-Name: Default Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Id: 8013ed9ae5ed46b9bc656f193c43e118 Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Project-Name: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Role: reader,member Aug 24 10:35:34.585368 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Roles: reader,member Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8013ed9ae5ed46b9bc656f193c43e118", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8013ed9ae5ed46b9bc656f193c43e118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}] Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Id: 8013ed9ae5ed46b9bc656f193c43e118 Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-Tenant-Name: tempest-TestVolumeBootPattern-1998904815 Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User: tempest-TestVolumeBootPattern-1998904815-project Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Id: default Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Domain-Name: Default Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Id: a71f15d0547a4d78b6d540e5eb5b2fbc Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: X-User-Name: tempest-TestVolumeBootPattern-1998904815-project Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: method: > Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: exception: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:35:34.587112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: action_args: {'id': '35a33e3c-4ed3-4aa3-9a74-0188df168459'} Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: {{(pid=121271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:35:34.588597 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. Aug 24 10:35:34.590418 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: ERROR nova.api.openstack.wsgi Aug 24 10:35:34.592233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: DEBUG nova.api.openstack.wsgi [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Returning 404 to user: Instance 35a33e3c-4ed3-4aa3-9a74-0188df168459 could not be found. {{(pid=121271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:35:34.592233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO nova.api.openstack.requestlog [None req-9624b991-1522-46b1-bbb8-83b042ef5053 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459" status: 404 len: 111 microversion: 2.1 time: 0.032317 Aug 24 10:35:34.592233 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: [pid: 121271|app: 0|req: 587/1164] 10.222.0.30 () {58 vars in 1236 bytes} [Wed Aug 24 10:35:34 2022] GET /compute/v2.1/servers/35a33e3c-4ed3-4aa3-9a74-0188df168459 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:35:36.178693 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: DEBUG nova.api.openstack.wsgi [None req-fd472743-001e-46fb-922f-3a60bc2d0190 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] Calling method '.version_select at 0x7f0af4160b80>' {{(pid=121270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:35:36.282868 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO nova.api.openstack.requestlog [None req-fd472743-001e-46fb-922f-3a60bc2d0190 tempest-TestVolumeBootPattern-1998904815 tempest-TestVolumeBootPattern-1998904815-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-894496397" status: 202 len: 0 microversion: 2.1 time: 0.108520 Aug 24 10:35:36.283442 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: [pid: 121270|app: 0|req: 578/1165] 10.222.0.30 () {58 vars in 1260 bytes} [Wed Aug 24 10:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-894496397 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:37:11.303471 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:37:11.303984 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Wed Aug 24 10:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:37:32.150715 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 24 10:37:32.151345 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Wed Aug 24 10:37:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:38:46.528383 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:38:46.529310 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Wed Aug 24 10:38:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:38:47.347742 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:38:47.348229 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Wed Aug 24 10:38:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:38:48.166931 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:38:48.167155 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Wed Aug 24 10:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:40:31.312112 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:40:31.312624 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Wed Aug 24 10:40:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:40:41.298100 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:40:41.298660 dv-cinder-854271-2-iscsi devstack@n-api.service[121271]: Wed Aug 24 10:40:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:40:52.158961 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:40:52.159584 dv-cinder-854271-2-iscsi devstack@n-api.service[121270]: Wed Aug 24 10:40:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!